Sep 10 15:32:01.879017 ip-10-0-136-122 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 15:32:02.292114 ip-10-0-136-122 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 15:32:02.292114 ip-10-0-136-122 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 15:32:02.292114 ip-10-0-136-122 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 15:32:02.292114 ip-10-0-136-122 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 15:32:02.292114 ip-10-0-136-122 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 15:32:02.293784 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.293694    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 15:32:02.298472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298458    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:32:02.298472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298472    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298475    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298479    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298482    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298485    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298488    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298491    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298494    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298498    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298501    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298503    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298508    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298517    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298520    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298523    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298526    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298529    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298532    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298535    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298538    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:32:02.298556 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298541    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298543    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298546    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298548    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298551    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298553    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298557    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298561    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298564    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298567    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298570    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298573    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298576    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298585    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298588    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298591    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298593    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298602    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298605    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:32:02.299055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298607    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298610    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298614    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298617    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298619    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298622    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298624    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298627    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298629    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298632    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298635    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298637    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298642    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298645    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298648    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298652    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298655    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298657    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298660    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:32:02.299503 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298662    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298665    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298667    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298670    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298672    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298675    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298678    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298680    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298683    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298685    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298688    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298691    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298699    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298701    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298704    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298706    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298709    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298712    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298714    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298717    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:32:02.300095 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298719    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298722    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298724    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298727    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298729    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298732    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298734    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298736    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298740    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298743    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298758    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298763    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298767    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298770    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298775    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298779    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298782    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298785    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298787    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:32:02.300576 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.298790    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299474    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299480    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299483    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299486    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299489    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299492    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299495    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299498    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299500    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299503    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299506    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299509    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299512    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299514    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299517    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299520    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299522    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299526    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:32:02.301055 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299529    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299532    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299536    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299539    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299541    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299544    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299546    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299549    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299552    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299554    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299556    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299560    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299564    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299567    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299570    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299573    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299576    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299578    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299583    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:32:02.301532 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299585    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299588    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299591    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299594    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299596    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299599    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299601    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299604    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299607    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299609    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299612    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299614    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299617    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299619    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299622    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299625    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299627    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299631    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299634    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299636    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:32:02.302015 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299639    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299641    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299643    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299646    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299649    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299651    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299653    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299656    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299659    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299661    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299664    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299666    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299669    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299671    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299674    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299677    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299679    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299682    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299684    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299687    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:32:02.302491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299689    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299692    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299695    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299698    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299701    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299704    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299707    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299711    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299714    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299716    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299719    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299722    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299725    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299727    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299730    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299732    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299735    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299737    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299740    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:32:02.303002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299743    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299745    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.299761    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300116    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300120    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300123    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300126    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300132    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300135    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300138    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300141    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300144    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300147    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300150    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300153    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300155    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300158    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300160    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300163    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300165    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:32:02.303472 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300168    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300171    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300174    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300176    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300179    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300182    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300184    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300187    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300190    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300192    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300195    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300197    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300200    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300203    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300205    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300208    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300211    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300213    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300216    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300218    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:32:02.303987 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300221    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300224    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300226    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300229    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300231    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300234    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300236    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300239    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300241    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300244    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300246    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300249    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300254    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300256    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300259    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300261    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300264    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300267    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300269    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300272    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:32:02.304476 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300274    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300277    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300280    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300282    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300285    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300287    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300289    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300293    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300296    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300299    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300302    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300305    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300307    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300310    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300314    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300316    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300319    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300322    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300325    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300327    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:32:02.304973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300330    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300333    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300336    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300339    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300343    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300345    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300349    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300352    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300356    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300359    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300361    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300364    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300367    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300371    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300374    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300377    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300380    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300384    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:32:02.305483 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300387    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300389    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300392    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.300395    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300488    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300526    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300532    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300537    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300541    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300544    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300549    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300553    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300556    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300559    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300563    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300566    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300569    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300572    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300577    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300580    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300583    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300586    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300591    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300593    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 15:32:02.305939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300596    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300600    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300603    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300606    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300609    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300613    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300616    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300619    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300622    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300625    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300628    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300630    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300634    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300637    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300640    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300643    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300646    2565 flags.go:64] FLAG: --enable-server="true"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300649    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300654    2565 flags.go:64] FLAG: --event-burst="100"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300658    2565 flags.go:64] FLAG: --event-qps="50"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300660    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300664    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300666    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300670    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 15:32:02.306551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300673    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300676    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300681    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300684    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300687    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300690    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300693    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300696    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300699    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300701    2565 flags.go:64] FLAG: --feature-gates=""
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300705    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300708    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300711    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300714    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300717    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300720    2565 flags.go:64] FLAG: --help="false"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300723    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300726    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300729    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300732    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300736    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300740    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300743    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 15:32:02.307153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300757    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300761    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300763    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300767    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300770    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300773    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300776    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300778    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300781    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300784    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300787    2565 flags.go:64] FLAG: --lock-file=""
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300791    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300794    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300797    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300802    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300805    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300808    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300810    2565 flags.go:64] FLAG: --logging-format="text"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300813    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300817    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300819    2565 flags.go:64] FLAG: --manifest-url=""
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300822    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300827    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300829    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300833    2565 flags.go:64] FLAG: --max-pods="110"
Sep 10 15:32:02.307766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300836    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300839    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300842    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300845    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300849    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300852    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300855    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300862    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300866    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300869    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300871    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300875    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300880    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300883    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300886    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300889    2565 flags.go:64] FLAG: --port="10250"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300892    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300895    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b8b5dfd07827b7ca"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300898    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300902    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300905    2565 flags.go:64] FLAG: --register-node="true"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300907    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300911    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300914    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 10 15:32:02.308390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300916    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300919    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300923    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300926    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300929    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300932    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300934    2565 flags.go:64] FLAG: --runonce="false"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300937    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300940    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300943    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300946    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300949    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300953    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300955    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300958    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300961    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300964    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300967    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300969    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300972    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300976    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300978    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300983    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300986    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300989    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 15:32:02.308989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300993    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300995    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.300999    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.301002    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.301005    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.301008    2565 flags.go:64] FLAG: --v="2"
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.301011    2565 flags.go:64] FLAG: --version="false"
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.301015    2565 flags.go:64] FLAG: --vmodule=""
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.301018    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.301021    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301130    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301134    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301138    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301141    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301144    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301147    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301150    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301153    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301155    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301160    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301163    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:32:02.309597 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301166    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301170    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301174    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301177    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301180    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301182    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301185    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301188    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301191    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301193    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301196    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301200    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301204    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301209    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301211    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301214    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301216    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301219    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301222    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:32:02.310163 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301225    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301227    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301230    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301232    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301235    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301238    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301240    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301243    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301246    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301248    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301251    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301255    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301257    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301260    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301263    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301265    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301268    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301271    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301273    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301276    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:32:02.310945 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301278    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301281    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301284    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301287    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301289    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301292    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301295    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301298    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301301    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301304    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301306    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301309    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301311    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301314    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301316    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301319    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301321    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301324    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301327    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301329    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:32:02.311596 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301332    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301334    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301337    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301340    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301343    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301345    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301350    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301353    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301356    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301359    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301362    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301364    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301367    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301369    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301372    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301375    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301377    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301380    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301385    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301387    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:32:02.312126 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301390    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301392    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301395    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301398    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301400    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301403    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301405    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301408    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.301410    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.302101    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.308909    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.308925    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.309700    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.309714    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 15:32:02.312614 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309790    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309796    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309800    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309803    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309806    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309809    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309812    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309815    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309818    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309821    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309823    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309826    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309829    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309831    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309834    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309837    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309840    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309842    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309845    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309848    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:32:02.312997 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309850    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309853    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309855    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309858    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309861    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309863    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309866    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309869    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309871    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309875    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309878    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309881    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309883    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309886    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309888    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309891    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309894    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309896    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309899    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309901    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:32:02.313496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309906    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309910    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309913    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309916    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309919    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309922    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309925    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309927    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309930    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309932    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309935    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309938    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309940    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309943    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309945    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309948    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309950    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309953    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309955    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309958    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:32:02.314029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309961    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309964    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309968    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309971    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309973    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309976    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309980    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309984    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309986    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309989    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309992    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309994    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.309997    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310000    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310002    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310005    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310007    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310010    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310012    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:32:02.314535 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310015    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310018    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310020    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310023    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310025    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310028    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310030    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310033    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310035    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310038    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310040    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310043    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310045    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310049    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310052    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310054    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310057    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310060    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310062    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:32:02.315156 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310064    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.310069    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310303    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310315    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310321    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310325    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310381    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310392    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310398    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310402    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310406    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310410    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310415    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310419    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310423    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 15:32:02.315615 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310427    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310432    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310436    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310440    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310444    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310455    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310459    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310470    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310475    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310479    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310484    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310488    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310493    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310497    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310501    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310506    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310511    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310515    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310524    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310528    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 15:32:02.316007 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310532    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310536    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310540    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310544    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310549    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310552    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310557    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310561    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310566    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310570    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310586    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310591    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310595    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310599    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310605    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310612    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310616    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310621    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310625    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 15:32:02.316491 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310630    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310635    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310639    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310644    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310655    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310661    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310666    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310671    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310678    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310685    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310690    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310694    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310698    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310703    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310707    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310716    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310720    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310725    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310729    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 15:32:02.316968 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310733    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310738    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310742    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310761    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310766    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310771    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310775    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310779    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310783    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310793    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310797    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310801    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310805    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310809    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310813    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310817    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310821    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310827    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310831    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310836    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 15:32:02.317435 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310840    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310849    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310853    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310858    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310862    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310866    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310870    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:02.310874    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.310882    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.311114    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.314412    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.315482    2565 server.go:1019] "Starting client certificate rotation"
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.315576    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 15:32:02.318038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.315613    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 15:32:02.318354 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.318092    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 15:32:02.320229 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.320214    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 15:32:02.334702 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.334682    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 10 15:32:02.337837 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.337823    2565 log.go:25] "Validated CRI v1 image API"
Sep 10 15:32:02.338575 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.338561    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 15:32:02.341105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.341087    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c487abef-0b0a-4034-a261-49ad9715542d:/dev/nvme0n1p4 f5f7ff70-aa90-428a-9abc-e29a9f78a013:/dev/nvme0n1p3]
Sep 10 15:32:02.341151 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.341105    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 15:32:02.345075 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.345059    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 15:32:02.347568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.347260    2565 manager.go:216] Machine: {Timestamp:2026-09-10 15:32:02.345578528 +0000 UTC m=+0.357864729 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119738 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cfc8c13ebcb7619904cb181b7dd6d SystemUUID:ec2cfc8c-13eb-cb76-1990-4cb181b7dd6d BootID:251ed0c7-b50c-47b0-87b7-04ea81ad358f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:1c:77:d4:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:1c:77:d4:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:40:02:8f:cb:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 15:32:02.347568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.347561    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 15:32:02.347687 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.347654    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 15:32:02.351442 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.351412    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 15:32:02.351592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.351444    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-122.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 15:32:02.352301 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.352291    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 15:32:02.352340 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.352303    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 15:32:02.352340 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.352311    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 15:32:02.353091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.353081    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 15:32:02.354338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.354328    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 15:32:02.358771 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.358759    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 15:32:02.358880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.358871    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 15:32:02.358918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.358900    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 15:32:02.358918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.358911    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 15:32:02.358972 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.358923    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 15:32:02.358972 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.358933    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 10 15:32:02.358972 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.358942    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 15:32:02.359279 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.359268    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 15:32:02.359318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.359286    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 15:32:02.361713 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.361692    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 15:32:02.364672 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.364656    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 15:32:02.364714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.364704    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 15:32:02.366309 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366298    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 15:32:02.366343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366315    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 15:32:02.366343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366321    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 15:32:02.366343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366327    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 15:32:02.366343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366336    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 15:32:02.366454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366345    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 15:32:02.366454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366363    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 15:32:02.366454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366369    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 15:32:02.366454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366376    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 15:32:02.366454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366381    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 15:32:02.366454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366395    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 15:32:02.366454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.366400    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 15:32:02.368134 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.368124    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 15:32:02.368166 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.368135    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 15:32:02.369822 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.369794    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 15:32:02.369822 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.369798    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 15:32:02.371933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.371921    2565 server.go:1268] "Started kubelet"
Sep 10 15:32:02.372017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.371990    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 15:32:02.372070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.372039    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 15:32:02.372126 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.371997    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 15:32:02.372799 ip-10-0-136-122 systemd[1]: Started Kubernetes Kubelet.
Sep 10 15:32:02.374070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.373987    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 15:32:02.374070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.374066    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 15:32:02.376537 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.376519    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 15:32:02.379506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.379489    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-122.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 15:32:02.380659 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.379559    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-122.ec2.internal.18d3ff6d68da8a71  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-122.ec2.internal,UID:ip-10-0-136-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-122.ec2.internal,},FirstTimestamp:2026-09-10 15:32:02.371889777 +0000 UTC m=+0.384175968,LastTimestamp:2026-09-10 15:32:02.371889777 +0000 UTC m=+0.384175968,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-122.ec2.internal,}"
Sep 10 15:32:02.381524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.381511    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 15:32:02.381575 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.381526    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 15:32:02.381634 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.381612    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:02.382650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.382553    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 15:32:02.382765 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.382739    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 15:32:02.382911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.382770    2565 factory.go:55] Registering systemd factory
Sep 10 15:32:02.382987 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.382908    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 10 15:32:02.382987 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.382947    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 15:32:02.382987 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.382957    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 15:32:02.382987 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.382570    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 15:32:02.383204 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.383187    2565 factory.go:153] Registering CRI-O factory
Sep 10 15:32:02.383204 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.383202    2565 factory.go:223] Registration of the crio container factory successfully
Sep 10 15:32:02.383364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.383254    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 15:32:02.383364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.383274    2565 factory.go:103] Registering Raw factory
Sep 10 15:32:02.383364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.383288    2565 manager.go:1196] Started watching for new ooms in manager
Sep 10 15:32:02.383850 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.383834    2565 manager.go:349] Starting recovery of all containers
Sep 10 15:32:02.385234 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.385212    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 15:32:02.385352 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.385333    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 15:32:02.389662 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.389621    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 15:32:02.395905 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.395883    2565 manager.go:354] Recovery completed
Sep 10 15:32:02.397567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.397452    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnlf9"
Sep 10 15:32:02.400138 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.400126    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:32:02.402673 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.402656    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:32:02.402742 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.402688    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:32:02.402742 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.402699    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:32:02.403276 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.403259    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 15:32:02.403276 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.403273    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 15:32:02.403396 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.403276    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:32:02.403396 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.403287    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 15:32:02.403463 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.403445    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnlf9"
Sep 10 15:32:02.404077 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.404058    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:32:02.404155 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.404092    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:32:02.404155 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.404106    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:32:02.405143 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.405070    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-122.ec2.internal.18d3ff6d6ab04b02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-122.ec2.internal,UID:ip-10-0-136-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-122.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-122.ec2.internal,},FirstTimestamp:2026-09-10 15:32:02.402675458 +0000 UTC m=+0.414961648,LastTimestamp:2026-09-10 15:32:02.402675458 +0000 UTC m=+0.414961648,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-122.ec2.internal,}"
Sep 10 15:32:02.413039 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.412971    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-122.ec2.internal.18d3ff6d6ab08ffc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-122.ec2.internal,UID:ip-10-0-136-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-122.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-122.ec2.internal,},FirstTimestamp:2026-09-10 15:32:02.402693116 +0000 UTC m=+0.414979307,LastTimestamp:2026-09-10 15:32:02.402693116 +0000 UTC m=+0.414979307,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-122.ec2.internal,}"
Sep 10 15:32:02.415867 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.415811    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-122.ec2.internal.18d3ff6d6ab0b754  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-122.ec2.internal,UID:ip-10-0-136-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-122.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-122.ec2.internal,},FirstTimestamp:2026-09-10 15:32:02.402703188 +0000 UTC m=+0.414989378,LastTimestamp:2026-09-10 15:32:02.402703188 +0000 UTC m=+0.414989378,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-122.ec2.internal,}"
Sep 10 15:32:02.421872 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.421794    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-122.ec2.internal.18d3ff6d6ab04b02\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-122.ec2.internal.18d3ff6d6ab04b02  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-122.ec2.internal,UID:ip-10-0-136-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-122.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-122.ec2.internal,},FirstTimestamp:2026-09-10 15:32:02.402675458 +0000 UTC m=+0.414961648,LastTimestamp:2026-09-10 15:32:02.404075927 +0000 UTC m=+0.416362119,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-122.ec2.internal,}"
Sep 10 15:32:02.424688 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.424609    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-122.ec2.internal.18d3ff6d6ab08ffc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-122.ec2.internal.18d3ff6d6ab08ffc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-122.ec2.internal,UID:ip-10-0-136-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-122.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-122.ec2.internal,},FirstTimestamp:2026-09-10 15:32:02.402693116 +0000 UTC m=+0.414979307,LastTimestamp:2026-09-10 15:32:02.404098907 +0000 UTC m=+0.416385098,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-122.ec2.internal,}"
Sep 10 15:32:02.433003 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.432948    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-122.ec2.internal.18d3ff6d6ab0b754\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-122.ec2.internal.18d3ff6d6ab0b754  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-122.ec2.internal,UID:ip-10-0-136-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-122.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-122.ec2.internal,},FirstTimestamp:2026-09-10 15:32:02.402703188 +0000 UTC m=+0.414989378,LastTimestamp:2026-09-10 15:32:02.404111549 +0000 UTC m=+0.416397741,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-122.ec2.internal,}"
Sep 10 15:32:02.482032 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.482017    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:02.573857 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.573781    2565 policy_none.go:49] "None policy: Start"
Sep 10 15:32:02.573857 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.573810    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 15:32:02.573857 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.573839    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 15:32:02.575869 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.575856    2565 policy_none.go:47] "Start"
Sep 10 15:32:02.597965 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.582120    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:02.598559 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.598544    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-122.ec2.internal\" not found" node="ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.603320 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.603308    2565 manager.go:337] "Starting Device Plugin manager"
Sep 10 15:32:02.603370 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.603340    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 15:32:02.603370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.603352    2565 server.go:87] "Starting device plugin registration server"
Sep 10 15:32:02.603677 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.603665    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 15:32:02.603713 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.603682    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 15:32:02.603795 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.603776    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 15:32:02.603873 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.603862    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 15:32:02.603922 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.603875    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 15:32:02.604487 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.604470    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 15:32:02.604550 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.604522    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:02.620033 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.620012    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 15:32:02.620117 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.620064    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 15:32:02.620117 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.620090    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 15:32:02.620220 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.620163    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 15:32:02.622143 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.622125    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:32:02.704154 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.704137    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:32:02.706506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.706489    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:32:02.706604 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.706521    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:32:02.706604 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.706536    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:32:02.706604 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.706564    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.715022 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.715003    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.715022 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.715021    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-122.ec2.internal\": node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:02.721534 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.720944    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal"]
Sep 10 15:32:02.721605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.721568    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:32:02.722225 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.722208    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:32:02.722319 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.722237    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:32:02.722319 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.722251    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:32:02.724574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.724561    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:32:02.724684 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.724669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.724729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.724697    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:32:02.725227 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.725209    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:32:02.725282 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.725238    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:32:02.725282 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.725247    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:32:02.725806 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.725790    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:32:02.725891 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.725819    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:32:02.725891 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.725831    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:32:02.728066 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.728044    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.728066 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.728068    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 15:32:02.728652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.728636    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 15:32:02.728725 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.728662    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 15:32:02.728725 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.728673    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeHasSufficientPID"
Sep 10 15:32:02.737468 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.737449    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:02.751323 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.751308    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-122.ec2.internal\" not found" node="ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.755468 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.755454    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-122.ec2.internal\" not found" node="ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.838193 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.838146    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:02.884676 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.884654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef07099b5b662d1965a4583a6980a110-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal\" (UID: \"ef07099b5b662d1965a4583a6980a110\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.884784 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.884701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef07099b5b662d1965a4583a6980a110-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal\" (UID: \"ef07099b5b662d1965a4583a6980a110\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.884784 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.884722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b09277e132d6aefa278e6b0df456da0-config\") pod \"kube-apiserver-proxy-ip-10-0-136-122.ec2.internal\" (UID: \"0b09277e132d6aefa278e6b0df456da0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.938758 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:02.938732    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:02.985121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.985097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef07099b5b662d1965a4583a6980a110-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal\" (UID: \"ef07099b5b662d1965a4583a6980a110\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.985196 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.985127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef07099b5b662d1965a4583a6980a110-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal\" (UID: \"ef07099b5b662d1965a4583a6980a110\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.985196 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.985142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b09277e132d6aefa278e6b0df456da0-config\") pod \"kube-apiserver-proxy-ip-10-0-136-122.ec2.internal\" (UID: \"0b09277e132d6aefa278e6b0df456da0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.985264 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.985203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b09277e132d6aefa278e6b0df456da0-config\") pod \"kube-apiserver-proxy-ip-10-0-136-122.ec2.internal\" (UID: \"0b09277e132d6aefa278e6b0df456da0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.985264 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.985210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef07099b5b662d1965a4583a6980a110-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal\" (UID: \"ef07099b5b662d1965a4583a6980a110\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:02.985264 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:02.985203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef07099b5b662d1965a4583a6980a110-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal\" (UID: \"ef07099b5b662d1965a4583a6980a110\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:03.039238 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:03.039217    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:03.054379 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:03.054362    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:03.059423 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:03.059390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:03.139830 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:03.139745    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:03.240347 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:03.240318    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:04.512068 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.512044    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 15:32:04.512444 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.512180    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 15:32:04.537589 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:04.537569    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:04.542874 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.542860    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:32:04.637807 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:04.637753    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-122.ec2.internal\" not found"
Sep 10 15:32:04.721541 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.721518    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:32:04.777152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.777112    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 15:27:03 +0000 UTC" deadline="2028-05-06 23:29:17.783108818 +0000 UTC"
Sep 10 15:32:04.777152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.777149    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14503h57m13.005962166s"
Sep 10 15:32:04.779268 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.779250    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:04.787908 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.787893    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 15:32:04.789498 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.789487    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal"
Sep 10 15:32:04.802149 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.802130    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 15:32:04.834897 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:04.834870    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef07099b5b662d1965a4583a6980a110.slice/crio-f063b6a33f839d6992f1a58b2c74b6ed138efa9a5c2f3e450e4ab6f7750b3379 WatchSource:0}: Error finding container f063b6a33f839d6992f1a58b2c74b6ed138efa9a5c2f3e450e4ab6f7750b3379: Status 404 returned error can't find the container with id f063b6a33f839d6992f1a58b2c74b6ed138efa9a5c2f3e450e4ab6f7750b3379
Sep 10 15:32:04.835425 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:04.835407    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b09277e132d6aefa278e6b0df456da0.slice/crio-0529315188f9a54e1fd740d0a43ffb4cd88d80a06f017ffc64e7444cbc8f3f37 WatchSource:0}: Error finding container 0529315188f9a54e1fd740d0a43ffb4cd88d80a06f017ffc64e7444cbc8f3f37: Status 404 returned error can't find the container with id 0529315188f9a54e1fd740d0a43ffb4cd88d80a06f017ffc64e7444cbc8f3f37
Sep 10 15:32:04.840060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.840046    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:32:04.925692 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:04.925642    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:32:05.557249 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.557220    2565 apiserver.go:52] "Watching apiserver"
Sep 10 15:32:05.564912 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.564588    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 15:32:05.569569 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.566664    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z","openshift-multus/multus-additional-cni-plugins-f6ncl","openshift-network-diagnostics/network-check-target-dx4hr","openshift-network-operator/iptables-alerter-qbhm2","openshift-ovn-kubernetes/ovnkube-node-sm2lv","kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sg6th","openshift-dns/node-resolver-8rbvn","openshift-image-registry/node-ca-s2ccc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal","openshift-multus/multus-qpvtl","openshift-multus/network-metrics-daemon-5qpdw","kube-system/global-pull-secret-syncer-4qndm","kube-system/konnectivity-agent-42c4g"]
Sep 10 15:32:05.569569 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.569340    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:05.569569 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.569442    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:05.571840 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.571817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.574313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.574291    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 15:32:05.574507 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.574479    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 15:32:05.574667 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.574652    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 15:32:05.574852 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.574830    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 15:32:05.575183 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.575162    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6f4kq\""
Sep 10 15:32:05.575270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.575190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.575551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.575534    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 15:32:05.577408 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.577388    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zzx8r\""
Sep 10 15:32:05.577602 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.577587    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:32:05.577676 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.577657    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 15:32:05.577871 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.577855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.579352 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.579335    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 15:32:05.581210 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.581192    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:32:05.581427 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.581410    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 15:32:05.581616 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.581602    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m4rc6\""
Sep 10 15:32:05.581802 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.581788    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 15:32:05.583280 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.583262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.585777 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.585759    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 15:32:05.586009 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.585985    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 15:32:05.586402 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.586386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 15:32:05.586598 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.586584    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 15:32:05.586796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.586778    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 15:32:05.587706 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.587685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.588502 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-systemd\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.588585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmmkg\" (UniqueName: \"kubernetes.io/projected/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-kube-api-access-xmmkg\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.588585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.588585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.588739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cnibin\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.588739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-host-slash\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.588739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-systemd\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.588739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-cni-netd\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.588739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-system-cni-dir\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.588739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysctl-conf\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.588739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-run\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.589088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-lib-modules\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.589088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-env-overrides\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.589088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-kubernetes\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.589088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.589088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysctl-d\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.589088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-var-lib-kubelet\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.589088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da346cf3-ace7-4a66-a349-571e2834050d-etc-tuned\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.589088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.588940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da346cf3-ace7-4a66-a349-571e2834050d-tmp\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.589443 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.589347    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 15:32:05.590064 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.589591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rz49d\""
Sep 10 15:32:05.590064 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590026    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 15:32:05.590328 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 15:32:05.590572 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ptkmb\""
Sep 10 15:32:05.590718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590695    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 15:32:05.590863 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-iptables-alerter-script\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.590927 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.590927 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-modprobe-d\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.591050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-host\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.591050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.590993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-var-lib-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-ovn\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-cni-bin\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovnkube-config\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.591239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld5km\" (UniqueName: \"kubernetes.io/projected/da346cf3-ace7-4a66-a349-571e2834050d-kube-api-access-ld5km\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.591239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-run-netns\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.591239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysconfig\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.591239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-sys\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-slash\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-etc-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-node-log\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovn-node-metrics-cert\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovnkube-script-lib\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnq9\" (UniqueName: \"kubernetes.io/projected/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-kube-api-access-slnq9\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-kubelet\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-systemd-units\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-log-socket\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.591594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fl2k\" (UniqueName: \"kubernetes.io/projected/04372fc7-12a8-459b-830f-3ce77f3fe2f0-kube-api-access-4fl2k\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.592179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.591810    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 15:32:05.593132 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.593117    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.595158 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.595139    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 15:32:05.595229 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.595214    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mcqq5\""
Sep 10 15:32:05.595534 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.595517    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 15:32:05.595746 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.595732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.597702 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.597684    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 15:32:05.597891 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.597874    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 15:32:05.598329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.598178    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 15:32:05.598329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.598221    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p7v6p\""
Sep 10 15:32:05.598771 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.598749    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.600832 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.600653    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ktlhh\""
Sep 10 15:32:05.600832 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.600766    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 15:32:05.603838 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.603818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:05.603938 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.603908    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:05.607773 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.607737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.608011 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.607979    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:05.610737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.610718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:05.612762 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.612731    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tc7kz"
Sep 10 15:32:05.613774 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.613755    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-prxxk\""
Sep 10 15:32:05.613858 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.613797    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 15:32:05.613927 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.613894    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 15:32:05.618781 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.618764    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tc7kz"
Sep 10 15:32:05.627620 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.627597    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 15:32:05.681421 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.681401    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 15:32:05.692745 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.692721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnq9\" (UniqueName: \"kubernetes.io/projected/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-kube-api-access-slnq9\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.692852 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.692750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-kubelet\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.692852 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.692768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-systemd-units\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.692852 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.692788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-systemd\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693020 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.692848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-kubelet\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.693020 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.692904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-systemd-units\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.693020 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.692971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-systemd\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693020 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.693206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85dba1d8-5e98-4ebd-a9af-9ec03a796293-cni-binary-copy\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.693206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-k8s-cni-cncf-io\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.693206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.693206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cnibin\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.693206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysctl-conf\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-run\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-run\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-lib-modules\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cnibin\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-env-overrides\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8tdw\" (UniqueName: \"kubernetes.io/projected/b48c88a3-d212-47b7-bb49-118f3d58fb3d-kube-api-access-m8tdw\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzhxn\" (UniqueName: \"kubernetes.io/projected/04488ced-232c-417b-9ec1-023c34e2a130-kube-api-access-bzhxn\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysctl-conf\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-kubernetes\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-kubernetes\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-lib-modules\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.693496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da346cf3-ace7-4a66-a349-571e2834050d-etc-tuned\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da346cf3-ace7-4a66-a349-571e2834050d-tmp\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-iptables-alerter-script\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-host\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-ovn\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-cni-bin\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04488ced-232c-417b-9ec1-023c34e2a130-serviceca\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693747    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mftqj\" (UniqueName: \"kubernetes.io/projected/9054b752-64ef-4b58-83e1-8f79a4042c00-kube-api-access-mftqj\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-env-overrides\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld5km\" (UniqueName: \"kubernetes.io/projected/da346cf3-ace7-4a66-a349-571e2834050d-kube-api-access-ld5km\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-ovn\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.694080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-tmp-dir\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-daemon-config\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-multus-certs\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.693973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysconfig\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-sys\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-etc-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-sys-fs\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68t2\" (UniqueName: \"kubernetes.io/projected/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-kube-api-access-x68t2\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694097    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-netns\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-etc-kubernetes\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-log-socket\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-sys\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.694833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694213    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-etc-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-log-socket\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl2k\" (UniqueName: \"kubernetes.io/projected/04372fc7-12a8-459b-830f-3ce77f3fe2f0-kube-api-access-4fl2k\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-cni-bin\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-host\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-device-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysconfig\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-cnibin\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-cni-bin\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-iptables-alerter-script\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694610    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/214a6aa5-61a6-4d2a-a24e-fc5a440635c2-agent-certs\") pod \"konnectivity-agent-42c4g\" (UID: \"214a6aa5-61a6-4d2a-a24e-fc5a440635c2\") " pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmmkg\" (UniqueName: \"kubernetes.io/projected/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-kube-api-access-xmmkg\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694747    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb44b5c1-8d56-4e63-80da-38fa93d65001-dbus\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/214a6aa5-61a6-4d2a-a24e-fc5a440635c2-konnectivity-ca\") pod \"konnectivity-agent-42c4g\" (UID: \"214a6aa5-61a6-4d2a-a24e-fc5a440635c2\") " pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:05.695614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-host-slash\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-systemd\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-cni-netd\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-run-systemd\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.694952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-host-slash\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb44b5c1-8d56-4e63-80da-38fa93d65001-kubelet-config\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-cni-netd\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-registration-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-hostroot\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wttd9\" (UniqueName: \"kubernetes.io/projected/85dba1d8-5e98-4ebd-a9af-9ec03a796293-kube-api-access-wttd9\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-system-cni-dir\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-system-cni-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-system-cni-dir\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovnkube-script-lib\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysctl-d\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-var-lib-kubelet\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.696341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovnkube-config\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-hosts-file\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-cni-multus\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-kubelet\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-var-lib-kubelet\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-modprobe-d\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695462    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-sysctl-d\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-var-lib-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-run-netns\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-etc-selinux\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-socket-dir-parent\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/da346cf3-ace7-4a66-a349-571e2834050d-etc-modprobe-d\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-var-lib-openvswitch\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-conf-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-run-netns\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-slash\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-node-log\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.697173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovn-node-metrics-cert\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovnkube-script-lib\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04488ced-232c-417b-9ec1-023c34e2a130-host\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-node-log\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04372fc7-12a8-459b-830f-3ce77f3fe2f0-host-slash\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-socket-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-cni-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.695821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.696025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovnkube-config\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.698049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.698014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da346cf3-ace7-4a66-a349-571e2834050d-tmp\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.698472 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.698058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/da346cf3-ace7-4a66-a349-571e2834050d-etc-tuned\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.698472 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.698374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04372fc7-12a8-459b-830f-3ce77f3fe2f0-ovn-node-metrics-cert\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.702017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.701999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnq9\" (UniqueName: \"kubernetes.io/projected/ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b-kube-api-access-slnq9\") pod \"multus-additional-cni-plugins-f6ncl\" (UID: \"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b\") " pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.704842 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.704823    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:32:05.704842 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.704843    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:32:05.705049 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.704853    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g457j for pod openshift-network-diagnostics/network-check-target-dx4hr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:05.705049 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.704925    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j podName:8ad37576-881a-466a-8501-67ef976a2005 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:06.204905024 +0000 UTC m=+3.019980743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g457j" (UniqueName: "kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j") pod "network-check-target-dx4hr" (UID: "8ad37576-881a-466a-8501-67ef976a2005") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:05.707216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.707186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fl2k\" (UniqueName: \"kubernetes.io/projected/04372fc7-12a8-459b-830f-3ce77f3fe2f0-kube-api-access-4fl2k\") pod \"ovnkube-node-sm2lv\" (UID: \"04372fc7-12a8-459b-830f-3ce77f3fe2f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.708033 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.707928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld5km\" (UniqueName: \"kubernetes.io/projected/da346cf3-ace7-4a66-a349-571e2834050d-kube-api-access-ld5km\") pod \"tuned-sg6th\" (UID: \"da346cf3-ace7-4a66-a349-571e2834050d\") " pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.708033 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.707997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmmkg\" (UniqueName: \"kubernetes.io/projected/2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c-kube-api-access-xmmkg\") pod \"iptables-alerter-qbhm2\" (UID: \"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c\") " pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.797075 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-hosts-file\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-cni-multus\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-kubelet\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-etc-selinux\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-socket-dir-parent\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-hosts-file\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-cni-multus\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-conf-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-kubelet\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-conf-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04488ced-232c-417b-9ec1-023c34e2a130-host\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-etc-selinux\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-socket-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-cni-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04488ced-232c-417b-9ec1-023c34e2a130-host\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85dba1d8-5e98-4ebd-a9af-9ec03a796293-cni-binary-copy\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-k8s-cni-cncf-io\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8tdw\" (UniqueName: \"kubernetes.io/projected/b48c88a3-d212-47b7-bb49-118f3d58fb3d-kube-api-access-m8tdw\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-socket-dir-parent\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzhxn\" (UniqueName: \"kubernetes.io/projected/04488ced-232c-417b-9ec1-023c34e2a130-kube-api-access-bzhxn\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-cni-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-k8s-cni-cncf-io\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04488ced-232c-417b-9ec1-023c34e2a130-serviceca\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-socket-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mftqj\" (UniqueName: \"kubernetes.io/projected/9054b752-64ef-4b58-83e1-8f79a4042c00-kube-api-access-mftqj\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.797689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-tmp-dir\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-daemon-config\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-multus-certs\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-sys-fs\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.797545    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68t2\" (UniqueName: \"kubernetes.io/projected/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-kube-api-access-x68t2\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-netns\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.797734    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret podName:cb44b5c1-8d56-4e63-80da-38fa93d65001 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:06.297715958 +0000 UTC m=+3.112791692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret") pod "global-pull-secret-syncer-4qndm" (UID: "cb44b5c1-8d56-4e63-80da-38fa93d65001") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-netns\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.797663    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:05.797771    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs podName:b48c88a3-d212-47b7-bb49-118f3d58fb3d nodeName:}" failed. No retries permitted until 2026-09-10 15:32:06.297763176 +0000 UTC m=+3.112838909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs") pod "network-metrics-daemon-5qpdw" (UID: "b48c88a3-d212-47b7-bb49-118f3d58fb3d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-run-multus-certs\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-sys-fs\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-etc-kubernetes\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-device-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.798505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-cnibin\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-device-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-cni-bin\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/214a6aa5-61a6-4d2a-a24e-fc5a440635c2-agent-certs\") pod \"konnectivity-agent-42c4g\" (UID: \"214a6aa5-61a6-4d2a-a24e-fc5a440635c2\") " pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-host-var-lib-cni-bin\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb44b5c1-8d56-4e63-80da-38fa93d65001-dbus\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.797928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-etc-kubernetes\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/214a6aa5-61a6-4d2a-a24e-fc5a440635c2-konnectivity-ca\") pod \"konnectivity-agent-42c4g\" (UID: \"214a6aa5-61a6-4d2a-a24e-fc5a440635c2\") " pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-tmp-dir\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb44b5c1-8d56-4e63-80da-38fa93d65001-kubelet-config\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb44b5c1-8d56-4e63-80da-38fa93d65001-dbus\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-registration-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb44b5c1-8d56-4e63-80da-38fa93d65001-kubelet-config\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-hostroot\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9054b752-64ef-4b58-83e1-8f79a4042c00-registration-dir\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttd9\" (UniqueName: \"kubernetes.io/projected/85dba1d8-5e98-4ebd-a9af-9ec03a796293-kube-api-access-wttd9\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-system-cni-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798129    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-cnibin\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-system-cni-dir\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799947 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85dba1d8-5e98-4ebd-a9af-9ec03a796293-hostroot\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799947 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85dba1d8-5e98-4ebd-a9af-9ec03a796293-multus-daemon-config\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799947 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85dba1d8-5e98-4ebd-a9af-9ec03a796293-cni-binary-copy\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.799947 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/214a6aa5-61a6-4d2a-a24e-fc5a440635c2-konnectivity-ca\") pod \"konnectivity-agent-42c4g\" (UID: \"214a6aa5-61a6-4d2a-a24e-fc5a440635c2\") " pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:05.799947 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.798813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04488ced-232c-417b-9ec1-023c34e2a130-serviceca\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.800804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.800782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/214a6aa5-61a6-4d2a-a24e-fc5a440635c2-agent-certs\") pod \"konnectivity-agent-42c4g\" (UID: \"214a6aa5-61a6-4d2a-a24e-fc5a440635c2\") " pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:05.806739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.806719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68t2\" (UniqueName: \"kubernetes.io/projected/8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20-kube-api-access-x68t2\") pod \"node-resolver-8rbvn\" (UID: \"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20\") " pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.806739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.806728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mftqj\" (UniqueName: \"kubernetes.io/projected/9054b752-64ef-4b58-83e1-8f79a4042c00-kube-api-access-mftqj\") pod \"aws-ebs-csi-driver-node-v7c7z\" (UID: \"9054b752-64ef-4b58-83e1-8f79a4042c00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.806902 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.806775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8tdw\" (UniqueName: \"kubernetes.io/projected/b48c88a3-d212-47b7-bb49-118f3d58fb3d-kube-api-access-m8tdw\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:05.807487 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.807437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wttd9\" (UniqueName: \"kubernetes.io/projected/85dba1d8-5e98-4ebd-a9af-9ec03a796293-kube-api-access-wttd9\") pod \"multus-qpvtl\" (UID: \"85dba1d8-5e98-4ebd-a9af-9ec03a796293\") " pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.807592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.807573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzhxn\" (UniqueName: \"kubernetes.io/projected/04488ced-232c-417b-9ec1-023c34e2a130-kube-api-access-bzhxn\") pod \"node-ca-s2ccc\" (UID: \"04488ced-232c-417b-9ec1-023c34e2a130\") " pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.822426 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.822381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal" event={"ID":"0b09277e132d6aefa278e6b0df456da0","Type":"ContainerStarted","Data":"0529315188f9a54e1fd740d0a43ffb4cd88d80a06f017ffc64e7444cbc8f3f37"}
Sep 10 15:32:05.823631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.823608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal" event={"ID":"ef07099b5b662d1965a4583a6980a110","Type":"ContainerStarted","Data":"f063b6a33f839d6992f1a58b2c74b6ed138efa9a5c2f3e450e4ab6f7750b3379"}
Sep 10 15:32:05.887849 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.887825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f6ncl"
Sep 10 15:32:05.897864 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.897842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sg6th"
Sep 10 15:32:05.911521 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.911503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qbhm2"
Sep 10 15:32:05.918098 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.918082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:05.926756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.926739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z"
Sep 10 15:32:05.935186 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.935167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8rbvn"
Sep 10 15:32:05.942664 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.942643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s2ccc"
Sep 10 15:32:05.950291 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.950273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpvtl"
Sep 10 15:32:05.961690 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:05.961673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:06.300526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.300455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:06.300526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.300503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:06.300729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.300536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:06.300729 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.300635    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:32:06.300729 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.300659    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:32:06.300729 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.300669    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g457j for pod openshift-network-diagnostics/network-check-target-dx4hr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:06.300729 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.300696    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:06.300729 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.300725    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j podName:8ad37576-881a-466a-8501-67ef976a2005 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:07.300707681 +0000 UTC m=+4.115783404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g457j" (UniqueName: "kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j") pod "network-check-target-dx4hr" (UID: "8ad37576-881a-466a-8501-67ef976a2005") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:06.300729 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.300637    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:06.301072 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.300753    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret podName:cb44b5c1-8d56-4e63-80da-38fa93d65001 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:07.300736625 +0000 UTC m=+4.115812357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret") pod "global-pull-secret-syncer-4qndm" (UID: "cb44b5c1-8d56-4e63-80da-38fa93d65001") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:06.301072 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.300772    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs podName:b48c88a3-d212-47b7-bb49-118f3d58fb3d nodeName:}" failed. No retries permitted until 2026-09-10 15:32:07.300762236 +0000 UTC m=+4.115837958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs") pod "network-metrics-daemon-5qpdw" (UID: "b48c88a3-d212-47b7-bb49-118f3d58fb3d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:06.622437 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.622338    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:27:05 +0000 UTC" deadline="2028-06-07 12:35:36.342565654 +0000 UTC"
Sep 10 15:32:06.622437 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.622380    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15261h3m29.720191771s"
Sep 10 15:32:06.719531 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:06.719303    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e98af8d_2a41_4fc6_9e7e_9d5280aa0a20.slice/crio-6d130a711db4e39c1523417e7e4d2bb9b49badfb7a41a05a1db64386b5fbb11c WatchSource:0}: Error finding container 6d130a711db4e39c1523417e7e4d2bb9b49badfb7a41a05a1db64386b5fbb11c: Status 404 returned error can't find the container with id 6d130a711db4e39c1523417e7e4d2bb9b49badfb7a41a05a1db64386b5fbb11c
Sep 10 15:32:06.723076 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:06.722659    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9054b752_64ef_4b58_83e1_8f79a4042c00.slice/crio-4f596b99179dcc7ed8b469db3caaafcab991e4d9504f38a5863a6b79263b5a75 WatchSource:0}: Error finding container 4f596b99179dcc7ed8b469db3caaafcab991e4d9504f38a5863a6b79263b5a75: Status 404 returned error can't find the container with id 4f596b99179dcc7ed8b469db3caaafcab991e4d9504f38a5863a6b79263b5a75
Sep 10 15:32:06.724846 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:06.724821    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04488ced_232c_417b_9ec1_023c34e2a130.slice/crio-fc6c4c7d1aaca132e4256af6a21655da9189192605b3b2fcd986081789cfddb0 WatchSource:0}: Error finding container fc6c4c7d1aaca132e4256af6a21655da9189192605b3b2fcd986081789cfddb0: Status 404 returned error can't find the container with id fc6c4c7d1aaca132e4256af6a21655da9189192605b3b2fcd986081789cfddb0
Sep 10 15:32:06.725394 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:06.725370    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda346cf3_ace7_4a66_a349_571e2834050d.slice/crio-946f9e63768302ba7494aee6a0e54720d85a95b959b86df17123a12ea343f029 WatchSource:0}: Error finding container 946f9e63768302ba7494aee6a0e54720d85a95b959b86df17123a12ea343f029: Status 404 returned error can't find the container with id 946f9e63768302ba7494aee6a0e54720d85a95b959b86df17123a12ea343f029
Sep 10 15:32:06.726354 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:06.726313    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85dba1d8_5e98_4ebd_a9af_9ec03a796293.slice/crio-dd0fecc5c4e65095d32a1e5f8700975719115650d8c0e1f1bf8d2f2f619d3a78 WatchSource:0}: Error finding container dd0fecc5c4e65095d32a1e5f8700975719115650d8c0e1f1bf8d2f2f619d3a78: Status 404 returned error can't find the container with id dd0fecc5c4e65095d32a1e5f8700975719115650d8c0e1f1bf8d2f2f619d3a78
Sep 10 15:32:06.727370 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:06.727347    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214a6aa5_61a6_4d2a_a24e_fc5a440635c2.slice/crio-054e2e49e77df9f34c5ce532aae431afc1227b33312ca18e494c303f94ae6884 WatchSource:0}: Error finding container 054e2e49e77df9f34c5ce532aae431afc1227b33312ca18e494c303f94ae6884: Status 404 returned error can't find the container with id 054e2e49e77df9f34c5ce532aae431afc1227b33312ca18e494c303f94ae6884
Sep 10 15:32:06.727988 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:06.727917    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c12c5c4_f41e_48d0_8f0c_2c0868d32f3c.slice/crio-625d82442311d40083ff598855f2581d96e0aef7b8c91c7ef0a9b68a74c37fb0 WatchSource:0}: Error finding container 625d82442311d40083ff598855f2581d96e0aef7b8c91c7ef0a9b68a74c37fb0: Status 404 returned error can't find the container with id 625d82442311d40083ff598855f2581d96e0aef7b8c91c7ef0a9b68a74c37fb0
Sep 10 15:32:06.817566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.817545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:06.817669 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.817631    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:06.817746 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.817728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:06.817844 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:06.817827    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:06.828236 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.828206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerStarted","Data":"d38e036ecafef62842a5d86a78c65c66c0179545454c16d3423f8f77abe26c28"}
Sep 10 15:32:06.829832 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.829811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"af6e9dc6f12326162b8c345f2b7fddcd1b845d7ad4bd0be7e82ee51dad0682e4"}
Sep 10 15:32:06.831428 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.831407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sg6th" event={"ID":"da346cf3-ace7-4a66-a349-571e2834050d","Type":"ContainerStarted","Data":"946f9e63768302ba7494aee6a0e54720d85a95b959b86df17123a12ea343f029"}
Sep 10 15:32:06.833699 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.833676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qbhm2" event={"ID":"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c","Type":"ContainerStarted","Data":"625d82442311d40083ff598855f2581d96e0aef7b8c91c7ef0a9b68a74c37fb0"}
Sep 10 15:32:06.835093 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.835076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpvtl" event={"ID":"85dba1d8-5e98-4ebd-a9af-9ec03a796293","Type":"ContainerStarted","Data":"dd0fecc5c4e65095d32a1e5f8700975719115650d8c0e1f1bf8d2f2f619d3a78"}
Sep 10 15:32:06.838157 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.838133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s2ccc" event={"ID":"04488ced-232c-417b-9ec1-023c34e2a130","Type":"ContainerStarted","Data":"fc6c4c7d1aaca132e4256af6a21655da9189192605b3b2fcd986081789cfddb0"}
Sep 10 15:32:06.841192 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.841169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z" event={"ID":"9054b752-64ef-4b58-83e1-8f79a4042c00","Type":"ContainerStarted","Data":"4f596b99179dcc7ed8b469db3caaafcab991e4d9504f38a5863a6b79263b5a75"}
Sep 10 15:32:06.842216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.842191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42c4g" event={"ID":"214a6aa5-61a6-4d2a-a24e-fc5a440635c2","Type":"ContainerStarted","Data":"054e2e49e77df9f34c5ce532aae431afc1227b33312ca18e494c303f94ae6884"}
Sep 10 15:32:06.843143 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.843125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8rbvn" event={"ID":"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20","Type":"ContainerStarted","Data":"6d130a711db4e39c1523417e7e4d2bb9b49badfb7a41a05a1db64386b5fbb11c"}
Sep 10 15:32:06.847457 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.847423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal" event={"ID":"0b09277e132d6aefa278e6b0df456da0","Type":"ContainerStarted","Data":"8bee06b46f9ea71893c7a925628a8b3350c5f8eecc65b1a4cfbb600d1504face"}
Sep 10 15:32:06.862871 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:06.862831    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-122.ec2.internal" podStartSLOduration=2.862819027 podStartE2EDuration="2.862819027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:06.862479604 +0000 UTC m=+3.677555344" watchObservedRunningTime="2026-09-10 15:32:06.862819027 +0000 UTC m=+3.677894767"
Sep 10 15:32:07.307884 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:07.307801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:07.307884 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:07.307859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:07.308145 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:07.307913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:07.308145 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.308059    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:32:07.308145 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.308078    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:32:07.308145 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.308089    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g457j for pod openshift-network-diagnostics/network-check-target-dx4hr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:07.308145 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.308141    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j podName:8ad37576-881a-466a-8501-67ef976a2005 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:09.308123877 +0000 UTC m=+6.123199609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g457j" (UniqueName: "kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j") pod "network-check-target-dx4hr" (UID: "8ad37576-881a-466a-8501-67ef976a2005") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:07.308528 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.308511    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:07.308600 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.308563    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret podName:cb44b5c1-8d56-4e63-80da-38fa93d65001 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:09.308549151 +0000 UTC m=+6.123624875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret") pod "global-pull-secret-syncer-4qndm" (UID: "cb44b5c1-8d56-4e63-80da-38fa93d65001") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:07.308662 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.308619    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:07.308662 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.308653    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs podName:b48c88a3-d212-47b7-bb49-118f3d58fb3d nodeName:}" failed. No retries permitted until 2026-09-10 15:32:09.30864225 +0000 UTC m=+6.123717983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs") pod "network-metrics-daemon-5qpdw" (UID: "b48c88a3-d212-47b7-bb49-118f3d58fb3d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:07.622784 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:07.622674    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:27:05 +0000 UTC" deadline="2028-06-26 03:25:39.22456571 +0000 UTC"
Sep 10 15:32:07.622784 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:07.622734    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15707h53m31.601835646s"
Sep 10 15:32:07.820483 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:07.820021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:07.820483 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:07.820148    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:07.863508 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:07.862878    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef07099b5b662d1965a4583a6980a110" containerID="5ec00e44ee4065e79ef2fe9cc90c3334182b968c8b28fe92008d8b511a1fc4d5" exitCode=0
Sep 10 15:32:07.863508 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:07.863025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal" event={"ID":"ef07099b5b662d1965a4583a6980a110","Type":"ContainerDied","Data":"5ec00e44ee4065e79ef2fe9cc90c3334182b968c8b28fe92008d8b511a1fc4d5"}
Sep 10 15:32:08.817929 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:08.817899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:08.818511 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:08.818048    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:08.818511 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:08.818155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:08.818511 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:08.818225    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:08.873410 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:08.873371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal" event={"ID":"ef07099b5b662d1965a4583a6980a110","Type":"ContainerStarted","Data":"afd9da6a68e410f92025b6240b9c9a3dfd4fe6f33a5cfee6d9bc123a62890d9b"}
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:09.323614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:09.323663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:09.323695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.323825    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.323881    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs podName:b48c88a3-d212-47b7-bb49-118f3d58fb3d nodeName:}" failed. No retries permitted until 2026-09-10 15:32:13.323862383 +0000 UTC m=+10.138938115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs") pod "network-metrics-daemon-5qpdw" (UID: "b48c88a3-d212-47b7-bb49-118f3d58fb3d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.324276    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.324293    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.324307    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g457j for pod openshift-network-diagnostics/network-check-target-dx4hr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.324352    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j podName:8ad37576-881a-466a-8501-67ef976a2005 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:13.324336435 +0000 UTC m=+10.139412166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g457j" (UniqueName: "kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j") pod "network-check-target-dx4hr" (UID: "8ad37576-881a-466a-8501-67ef976a2005") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.324410    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:09.324473 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.324442    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret podName:cb44b5c1-8d56-4e63-80da-38fa93d65001 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:13.324431482 +0000 UTC m=+10.139507214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret") pod "global-pull-secret-syncer-4qndm" (UID: "cb44b5c1-8d56-4e63-80da-38fa93d65001") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:09.821009 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:09.820383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:09.821009 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:09.820581    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:10.818200 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:10.818170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:10.818451 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:10.818182    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:10.818451 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:10.818308    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:10.818451 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:10.818356    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:11.819180 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:11.819149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:11.819712 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:11.819301    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:12.818159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:12.818125    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:12.818319 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:12.818257    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:12.818433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:12.818326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:12.818507 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:12.818432    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:13.355866 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:13.355829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:13.355903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.356005    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.356042    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:13.356047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.356062    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.356079    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs podName:b48c88a3-d212-47b7-bb49-118f3d58fb3d nodeName:}" failed. No retries permitted until 2026-09-10 15:32:21.356058184 +0000 UTC m=+18.171133922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs") pod "network-metrics-daemon-5qpdw" (UID: "b48c88a3-d212-47b7-bb49-118f3d58fb3d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.356081    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g457j for pod openshift-network-diagnostics/network-check-target-dx4hr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.356150    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.356191    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j podName:8ad37576-881a-466a-8501-67ef976a2005 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:21.356171196 +0000 UTC m=+18.171246916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g457j" (UniqueName: "kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j") pod "network-check-target-dx4hr" (UID: "8ad37576-881a-466a-8501-67ef976a2005") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:13.356353 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.356212    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret podName:cb44b5c1-8d56-4e63-80da-38fa93d65001 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:21.356203371 +0000 UTC m=+18.171279095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret") pod "global-pull-secret-syncer-4qndm" (UID: "cb44b5c1-8d56-4e63-80da-38fa93d65001") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:13.819449 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:13.818810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:13.819449 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:13.818927    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:14.818265 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:14.818185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:14.818265 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:14.818231    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:14.818755 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:14.818315    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:14.818755 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:14.818446    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:15.818519 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:15.818483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:15.818990 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:15.818637    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:16.818330 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:16.818297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:16.818462 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:16.818297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:16.818462 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:16.818396    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:16.818539 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:16.818496    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:17.818130 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:17.817915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:17.818313 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:17.818232    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:18.818500 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:18.818473    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:18.818947 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:18.818483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:18.818947 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:18.818567    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:18.818947 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:18.818665    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:19.817919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:19.817887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:19.818112 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:19.818041    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:20.818452 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:20.818414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:20.818996 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:20.818530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:20.818996 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:20.818584    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:20.818996 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:20.818676    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:21.416603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:21.416563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:21.416603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:21.416617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:21.416853 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:21.416648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:21.416853 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.416799    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:21.416853 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.416818    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:32:21.416853 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.416842    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:32:21.416853 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.416851    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs podName:b48c88a3-d212-47b7-bb49-118f3d58fb3d nodeName:}" failed. No retries permitted until 2026-09-10 15:32:37.416835768 +0000 UTC m=+34.231911487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs") pod "network-metrics-daemon-5qpdw" (UID: "b48c88a3-d212-47b7-bb49-118f3d58fb3d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:21.416853 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.416855    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g457j for pod openshift-network-diagnostics/network-check-target-dx4hr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:21.417192 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.416910    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j podName:8ad37576-881a-466a-8501-67ef976a2005 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:37.416895521 +0000 UTC m=+34.231971239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g457j" (UniqueName: "kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j") pod "network-check-target-dx4hr" (UID: "8ad37576-881a-466a-8501-67ef976a2005") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:21.417192 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.416816    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:21.417192 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.416955    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret podName:cb44b5c1-8d56-4e63-80da-38fa93d65001 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:37.416944817 +0000 UTC m=+34.232020553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret") pod "global-pull-secret-syncer-4qndm" (UID: "cb44b5c1-8d56-4e63-80da-38fa93d65001") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:21.818413 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:21.818322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:21.818571 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:21.818447    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:22.818494 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:22.818458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:22.818494 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:22.818504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:22.819070 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:22.818608    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:22.819070 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:22.818751    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:23.819324 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:23.819291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:23.819763 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:23.819420    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:24.817723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.817698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:24.817816 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.817695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:24.817816 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:24.817798    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:24.817942 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:24.817924    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:24.909236 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.909042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z" event={"ID":"9054b752-64ef-4b58-83e1-8f79a4042c00","Type":"ContainerStarted","Data":"39f3d360834087d2e2a0a6fe35287aabdb90a430a9dd491220b39f1654b0e548"}
Sep 10 15:32:24.910583 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.910551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42c4g" event={"ID":"214a6aa5-61a6-4d2a-a24e-fc5a440635c2","Type":"ContainerStarted","Data":"3762a99df5541d51286acc5c7d38623a5f30506588f389422f4a284742434040"}
Sep 10 15:32:24.912005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.911982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8rbvn" event={"ID":"8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20","Type":"ContainerStarted","Data":"d36aea43c96b387b0a7f514be9ea6a26215fcc8f88a99f662ba45f805d0fddef"}
Sep 10 15:32:24.913704 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.913675    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b" containerID="c675c31385db010014dd776f513903c357afd4bca76ac61e40b6d2dbee869175" exitCode=0
Sep 10 15:32:24.913802 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.913747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerDied","Data":"c675c31385db010014dd776f513903c357afd4bca76ac61e40b6d2dbee869175"}
Sep 10 15:32:24.916188 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.916169    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:32:24.916553 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.916526    2565 generic.go:356] "Generic (PLEG): container finished" podID="04372fc7-12a8-459b-830f-3ce77f3fe2f0" containerID="523da0f8a48d35c0d8442fe73d376ad24f3ab82744e2896d515e464371eb2e00" exitCode=1
Sep 10 15:32:24.916718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.916588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"5b98538722bffda52cc7405b4ae52cabe660e90a582d215c153094bb11dff60c"}
Sep 10 15:32:24.916718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.916639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"e35b6d2ab31b5e74f3b3568d29ff645e65eaed599e60650bf08c0e62ca2504c1"}
Sep 10 15:32:24.916718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.916685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerDied","Data":"523da0f8a48d35c0d8442fe73d376ad24f3ab82744e2896d515e464371eb2e00"}
Sep 10 15:32:24.916852 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.916737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"1c5ed003e0db248a160806f30f76c253bc0b9a1c7da4893e6367becd8be6ebb7"}
Sep 10 15:32:24.918277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.918249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sg6th" event={"ID":"da346cf3-ace7-4a66-a349-571e2834050d","Type":"ContainerStarted","Data":"f8b87f7b5de77efb4f60d68590f6ad366b2abf72b6daee96db9de0efec01e4a8"}
Sep 10 15:32:24.919852 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.919807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpvtl" event={"ID":"85dba1d8-5e98-4ebd-a9af-9ec03a796293","Type":"ContainerStarted","Data":"64196b60864da0c367e817bfea9fea2b46f7b14ecc1def59e4c6d1d73232fbf9"}
Sep 10 15:32:24.921426 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.921409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s2ccc" event={"ID":"04488ced-232c-417b-9ec1-023c34e2a130","Type":"ContainerStarted","Data":"b781d9e7c8359b2254d8835a3a61534d0c5fe0fbb52707ce911f65820008d03f"}
Sep 10 15:32:24.926711 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.926665    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-42c4g" podStartSLOduration=10.684775301 podStartE2EDuration="20.926651718s" totalImagesPullingTime="10.241876417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:24.926518448 +0000 UTC m=+21.741594187" watchObservedRunningTime="2026-09-10 15:32:24.926651718 +0000 UTC m=+21.741727457"
Sep 10 15:32:24.927237 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.927204    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-122.ec2.internal" podStartSLOduration=20.927196371 podStartE2EDuration="20.927196371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:08.889861409 +0000 UTC m=+5.704937152" watchObservedRunningTime="2026-09-10 15:32:24.927196371 +0000 UTC m=+21.742272111"
Sep 10 15:32:24.962366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.962322    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sg6th" podStartSLOduration=3.2541184530000002 podStartE2EDuration="20.962306947s" totalImagesPullingTime="17.708188494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:24.961889158 +0000 UTC m=+21.776964897" watchObservedRunningTime="2026-09-10 15:32:24.962306947 +0000 UTC m=+21.777382687"
Sep 10 15:32:24.976418 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.976370    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8rbvn" podStartSLOduration=3.279111249 podStartE2EDuration="20.976353881s" totalImagesPullingTime="17.697242632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:24.975953334 +0000 UTC m=+21.791029079" watchObservedRunningTime="2026-09-10 15:32:24.976353881 +0000 UTC m=+21.791429620"
Sep 10 15:32:24.991672 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:24.991613    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s2ccc" podStartSLOduration=3.283962293 podStartE2EDuration="20.991590436s" totalImagesPullingTime="17.707628143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:24.990525143 +0000 UTC m=+21.805600884" watchObservedRunningTime="2026-09-10 15:32:24.991590436 +0000 UTC m=+21.806666176"
Sep 10 15:32:25.020688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:25.020647    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qpvtl" podStartSLOduration=2.936660999 podStartE2EDuration="21.020631131s" totalImagesPullingTime="18.083970132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:25.0203172 +0000 UTC m=+21.835392943" watchObservedRunningTime="2026-09-10 15:32:25.020631131 +0000 UTC m=+21.835706871"
Sep 10 15:32:25.818011 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:25.817915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:25.818268 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:25.818060    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:25.924789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:25.924752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qbhm2" event={"ID":"2c12c5c4-f41e-48d0-8f0c-2c0868d32f3c","Type":"ContainerStarted","Data":"6314265a35507f9b8373abe71dd771461e461918880723190aed5903caa638f8"}
Sep 10 15:32:25.928116 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:25.928092    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:32:25.929370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:25.928910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"d267e9352e34c77f5845a94d70fd075aefe2e155548e66078e8eeda38a498a59"}
Sep 10 15:32:25.929370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:25.929019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"ddb12a307c435a378afeea89fdc82dc38f5d449355059c2cc917e3b13a236828"}
Sep 10 15:32:25.939113 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:25.939059    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qbhm2" podStartSLOduration=4.237296102 podStartE2EDuration="21.939043532s" totalImagesPullingTime="17.70174743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:25.938785618 +0000 UTC m=+22.753861357" watchObservedRunningTime="2026-09-10 15:32:25.939043532 +0000 UTC m=+22.754119271"
Sep 10 15:32:26.250299 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:26.250148    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 15:32:26.812104 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:26.811951    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T15:32:26.250295724Z","UUID":"1bb6bde2-0140-48dd-9590-8f582d6acfa0","Handler":null,"Name":"","Endpoint":""}
Sep 10 15:32:26.813362 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:26.813343    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 15:32:26.813480 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:26.813377    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 15:32:26.817678 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:26.817656    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:26.817789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:26.817661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:26.817789 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:26.817757    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:26.817884 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:26.817846    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:26.933519 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:26.933475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z" event={"ID":"9054b752-64ef-4b58-83e1-8f79a4042c00","Type":"ContainerStarted","Data":"355d276ce2fd5edfb1d0e0aa67efc55cf99d6ed1047405cad6de2ac81c1b8e72"}
Sep 10 15:32:27.783911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:27.783816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:27.784460 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:27.784442    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:27.818272 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:27.818237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:27.818427 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:27.818389    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:27.937307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:27.937269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z" event={"ID":"9054b752-64ef-4b58-83e1-8f79a4042c00","Type":"ContainerStarted","Data":"47132fb38065a07e0a586805b60239112daa90b5984a2cf7fc8cec07a83872bd"}
Sep 10 15:32:27.940400 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:27.940373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:32:27.940799 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:27.940777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"02adb5837d5cc35448bb90891fc088f81277b080abf45296d01a54bd4bb00536"}
Sep 10 15:32:27.953713 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:27.953665    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v7c7z" podStartSLOduration=3.602647577 podStartE2EDuration="23.953647233s" totalImagesPullingTime="20.350999656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:27.952975352 +0000 UTC m=+24.768051084" watchObservedRunningTime="2026-09-10 15:32:27.953647233 +0000 UTC m=+24.768722973"
Sep 10 15:32:28.817995 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:28.817953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:28.818214 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:28.817954    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:28.818214 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:28.818081    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:28.818214 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:28.818168    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:29.818613 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.818357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:29.819023 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:29.818738    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:29.949475 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.949447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:32:29.949925 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.949900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"c0567d8b9e743235a03c7d0139967dc0c65fe75119dc8663664a321e454c1a3e"}
Sep 10 15:32:29.950228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.950207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:29.950338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.950275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:29.950338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.950324    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:29.950433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.950408    2565 scope.go:117] "RemoveContainer" containerID="523da0f8a48d35c0d8442fe73d376ad24f3ab82744e2896d515e464371eb2e00"
Sep 10 15:32:29.966864 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.966836    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:29.967056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:29.967008    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:32:30.818253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:30.818218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:30.818447 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:30.818218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:30.818447 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:30.818372    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:30.818447 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:30.818390    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:31.283467 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.283439    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:31.284047 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.283561    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 15:32:31.284125 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.284107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-42c4g"
Sep 10 15:32:31.365455 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.365417    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5qpdw"]
Sep 10 15:32:31.365612 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.365597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:31.365737 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:31.365717    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:31.368131 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.368108    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qndm"]
Sep 10 15:32:31.368208 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.368191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:31.368289 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:31.368269    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:31.369175 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.369032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dx4hr"]
Sep 10 15:32:31.369175 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.369111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:31.369258 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:31.369190    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:31.956161 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.956126    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b" containerID="71c245bd49fc18f173ee5a2ef08fb62e0e683fa4d4efcba7927ed5283cf96b28" exitCode=0
Sep 10 15:32:31.956303 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.956224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerDied","Data":"71c245bd49fc18f173ee5a2ef08fb62e0e683fa4d4efcba7927ed5283cf96b28"}
Sep 10 15:32:31.963898 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.963877    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:32:31.964405 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:31.964375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" event={"ID":"04372fc7-12a8-459b-830f-3ce77f3fe2f0","Type":"ContainerStarted","Data":"627d7b449c9f0fb4ada64a8e4247d39cb56f8471c2016f290efe75c322930fb5"}
Sep 10 15:32:32.007412 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:32.007362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv" podStartSLOduration=10.280733237 podStartE2EDuration="28.007348616s" totalImagesPullingTime="17.726615379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:32.007094919 +0000 UTC m=+28.822170660" watchObservedRunningTime="2026-09-10 15:32:32.007348616 +0000 UTC m=+28.822424356"
Sep 10 15:32:32.818045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:32.818014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:32.818045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:32.818036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:32.818521 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:32.818036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:32.818521 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:32.818126    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:32.818521 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:32.818198    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:32.818521 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:32.818242    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:33.970357 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:33.970169    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b" containerID="0443a24027bfbdb63b6efb37984f82e72beda5857ff1fac74d93c0800ac6ab32" exitCode=0
Sep 10 15:32:33.970739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:33.970234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerDied","Data":"0443a24027bfbdb63b6efb37984f82e72beda5857ff1fac74d93c0800ac6ab32"}
Sep 10 15:32:34.818464 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:34.818433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:34.818464 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:34.818459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:34.818648 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:34.818459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:34.818648 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:34.818532    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:34.818648 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:34.818610    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:34.818732 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:34.818675    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:34.975610 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:34.975578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerStarted","Data":"0d60573c4cc356874ec3a0ff0a1e0b563bf338104c976c7d470cd50295c25348"}
Sep 10 15:32:35.980059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:35.980025    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b" containerID="0d60573c4cc356874ec3a0ff0a1e0b563bf338104c976c7d470cd50295c25348" exitCode=0
Sep 10 15:32:35.980493 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:35.980093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerDied","Data":"0d60573c4cc356874ec3a0ff0a1e0b563bf338104c976c7d470cd50295c25348"}
Sep 10 15:32:36.818403 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:36.818363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:36.818660 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:36.818410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:36.818660 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:36.818461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:36.818660 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:36.818471    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qndm" podUID="cb44b5c1-8d56-4e63-80da-38fa93d65001"
Sep 10 15:32:36.818660 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:36.818523    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dx4hr" podUID="8ad37576-881a-466a-8501-67ef976a2005"
Sep 10 15:32:36.818660 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:36.818619    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qpdw" podUID="b48c88a3-d212-47b7-bb49-118f3d58fb3d"
Sep 10 15:32:37.438909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.438880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.438932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.438996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.439065    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.439083    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.439118    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.439134    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.439137    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret podName:cb44b5c1-8d56-4e63-80da-38fa93d65001 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.439118435 +0000 UTC m=+66.254194172 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret") pod "global-pull-secret-syncer-4qndm" (UID: "cb44b5c1-8d56-4e63-80da-38fa93d65001") : object "kube-system"/"original-pull-secret" not registered
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.439146    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g457j for pod openshift-network-diagnostics/network-check-target-dx4hr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.439156    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs podName:b48c88a3-d212-47b7-bb49-118f3d58fb3d nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.439145615 +0000 UTC m=+66.254221333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs") pod "network-metrics-daemon-5qpdw" (UID: "b48c88a3-d212-47b7-bb49-118f3d58fb3d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 15:32:37.439364 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.439184    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j podName:8ad37576-881a-466a-8501-67ef976a2005 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.439173933 +0000 UTC m=+66.254249651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g457j" (UniqueName: "kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j") pod "network-check-target-dx4hr" (UID: "8ad37576-881a-466a-8501-67ef976a2005") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 15:32:37.499325 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.499264    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-122.ec2.internal" event="NodeReady"
Sep 10 15:32:37.499440 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.499374    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 15:32:37.532082 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.532055    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c696c4f5b-drx9s"]
Sep 10 15:32:37.552569 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.551828    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8pvt4"]
Sep 10 15:32:37.552569 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.551908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.554336 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.554310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 15:32:37.554488 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.554320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 15:32:37.554764 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.554744    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wjsnb\""
Sep 10 15:32:37.555011 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.554990    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 15:32:37.562332 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.562304    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 15:32:37.569891 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.569869    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7kl4j"]
Sep 10 15:32:37.570011 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.569996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.573062 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.573041    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 15:32:37.573174 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.573104    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bddbj\""
Sep 10 15:32:37.573360 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.573342    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 15:32:37.587364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.587345    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c696c4f5b-drx9s"]
Sep 10 15:32:37.587465 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.587379    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8pvt4"]
Sep 10 15:32:37.587465 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.587404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7kl4j"]
Sep 10 15:32:37.587559 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.587471    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7kl4j"
Sep 10 15:32:37.589628 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.589610    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 15:32:37.589735 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.589644    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 15:32:37.589796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.589782    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 15:32:37.589849 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.589818    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t4nnn\""
Sep 10 15:32:37.640689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-trusted-ca\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.640789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-installation-pull-secrets\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.640789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-bound-sa-token\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.640868 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frg5j\" (UniqueName: \"kubernetes.io/projected/a2bdf391-fbbf-4277-a0df-48771809d7f2-kube-api-access-frg5j\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.640868 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnw9\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-kube-api-access-9cnw9\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.640868 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-image-registry-private-configuration\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.640868 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.641032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2bdf391-fbbf-4277-a0df-48771809d7f2-config-volume\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.641032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-certificates\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.641032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.641032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.640987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-ca-trust-extracted\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.641032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.641008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2bdf391-fbbf-4277-a0df-48771809d7f2-tmp-dir\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.712821 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.712725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:37.741572 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-image-registry-private-configuration\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.741572 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2bdf391-fbbf-4277-a0df-48771809d7f2-config-volume\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-certificates\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e17b5c-42fa-4eec-b61a-2eb94a534625-cert\") pod \"ingress-canary-7kl4j\" (UID: \"c1e17b5c-42fa-4eec-b61a-2eb94a534625\") " pod="openshift-ingress-canary/ingress-canary-7kl4j"
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-ca-trust-extracted\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.741723    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.741742    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c696c4f5b-drx9s: secret "image-registry-tls" not found
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2bdf391-fbbf-4277-a0df-48771809d7f2-tmp-dir\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.741786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkzkg\" (UniqueName: \"kubernetes.io/projected/c1e17b5c-42fa-4eec-b61a-2eb94a534625-kube-api-access-kkzkg\") pod \"ingress-canary-7kl4j\" (UID: \"c1e17b5c-42fa-4eec-b61a-2eb94a534625\") " pod="openshift-ingress-canary/ingress-canary-7kl4j"
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.741813    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls podName:0b995ff5-f42a-4fa3-8e00-d2f90a02decf nodeName:}" failed. No retries permitted until 2026-09-10 15:32:38.241791841 +0000 UTC m=+35.056867573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls") pod "image-registry-c696c4f5b-drx9s" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf") : secret "image-registry-tls" not found
Sep 10 15:32:37.741880 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.741883    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:37.742079    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls podName:a2bdf391-fbbf-4277-a0df-48771809d7f2 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:38.242064282 +0000 UTC m=+35.057140007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls") pod "dns-default-8pvt4" (UID: "a2bdf391-fbbf-4277-a0df-48771809d7f2") : secret "dns-default-metrics-tls" not found
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-trusted-ca\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-installation-pull-secrets\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-bound-sa-token\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-ca-trust-extracted\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frg5j\" (UniqueName: \"kubernetes.io/projected/a2bdf391-fbbf-4277-a0df-48771809d7f2-kube-api-access-frg5j\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnw9\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-kube-api-access-9cnw9\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2bdf391-fbbf-4277-a0df-48771809d7f2-config-volume\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.742376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-certificates\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.742721 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2bdf391-fbbf-4277-a0df-48771809d7f2-tmp-dir\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.742981 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.742925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-trusted-ca\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.746342 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.746319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-installation-pull-secrets\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.746469 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.746450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-image-registry-private-configuration\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.753843 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.753787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-bound-sa-token\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.754491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.754468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frg5j\" (UniqueName: \"kubernetes.io/projected/a2bdf391-fbbf-4277-a0df-48771809d7f2-kube-api-access-frg5j\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:37.755557 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.755531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnw9\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-kube-api-access-9cnw9\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:37.843046 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.843015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e17b5c-42fa-4eec-b61a-2eb94a534625-cert\") pod \"ingress-canary-7kl4j\" (UID: \"c1e17b5c-42fa-4eec-b61a-2eb94a534625\") " pod="openshift-ingress-canary/ingress-canary-7kl4j"
Sep 10 15:32:37.843183 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.843071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkzkg\" (UniqueName: \"kubernetes.io/projected/c1e17b5c-42fa-4eec-b61a-2eb94a534625-kube-api-access-kkzkg\") pod \"ingress-canary-7kl4j\" (UID: \"c1e17b5c-42fa-4eec-b61a-2eb94a534625\") " pod="openshift-ingress-canary/ingress-canary-7kl4j"
Sep 10 15:32:37.845067 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.845035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:37.845697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.845679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1e17b5c-42fa-4eec-b61a-2eb94a534625-cert\") pod \"ingress-canary-7kl4j\" (UID: \"c1e17b5c-42fa-4eec-b61a-2eb94a534625\") " pod="openshift-ingress-canary/ingress-canary-7kl4j"
Sep 10 15:32:37.851104 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.851085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkzkg\" (UniqueName: \"kubernetes.io/projected/c1e17b5c-42fa-4eec-b61a-2eb94a534625-kube-api-access-kkzkg\") pod \"ingress-canary-7kl4j\" (UID: \"c1e17b5c-42fa-4eec-b61a-2eb94a534625\") " pod="openshift-ingress-canary/ingress-canary-7kl4j"
Sep 10 15:32:37.897476 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.897437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7kl4j"
Sep 10 15:32:37.945744 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:37.945706    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:38.093795 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.093708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:38.187029 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.186987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:38.189471 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.189444    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7kl4j"]
Sep 10 15:32:38.194143 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:32:38.194112    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e17b5c_42fa_4eec_b61a_2eb94a534625.slice/crio-df17696890179e8f3e5d9a6b1edab486404e081b92fb9b259fc885af2609ec9a WatchSource:0}: Error finding container df17696890179e8f3e5d9a6b1edab486404e081b92fb9b259fc885af2609ec9a: Status 404 returned error can't find the container with id df17696890179e8f3e5d9a6b1edab486404e081b92fb9b259fc885af2609ec9a
Sep 10 15:32:38.247119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.247083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:38.247119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.247124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:38.247325 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:38.247230    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:32:38.247325 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:38.247237    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:32:38.247325 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:38.247256    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c696c4f5b-drx9s: secret "image-registry-tls" not found
Sep 10 15:32:38.247325 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:38.247282    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls podName:a2bdf391-fbbf-4277-a0df-48771809d7f2 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:39.247267739 +0000 UTC m=+36.062343456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls") pod "dns-default-8pvt4" (UID: "a2bdf391-fbbf-4277-a0df-48771809d7f2") : secret "dns-default-metrics-tls" not found
Sep 10 15:32:38.247325 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:38.247311    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls podName:0b995ff5-f42a-4fa3-8e00-d2f90a02decf nodeName:}" failed. No retries permitted until 2026-09-10 15:32:39.247297392 +0000 UTC m=+36.062373139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls") pod "image-registry-c696c4f5b-drx9s" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf") : secret "image-registry-tls" not found
Sep 10 15:32:38.289204 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.289165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:38.401079 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.400990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:38.502506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.502469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:38.818284 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.818211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:32:38.818475 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.818224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:32:38.818475 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.818373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:32:38.821145 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.821118    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 15:32:38.821843 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.821821    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 15:32:38.822149 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.822129    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gcptc\""
Sep 10 15:32:38.822381 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.822363    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-skj7z\""
Sep 10 15:32:38.822489 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.822380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 15:32:38.822489 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.822389    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 15:32:38.943040 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.943004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:38.988392 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:38.988351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7kl4j" event={"ID":"c1e17b5c-42fa-4eec-b61a-2eb94a534625","Type":"ContainerStarted","Data":"df17696890179e8f3e5d9a6b1edab486404e081b92fb9b259fc885af2609ec9a"}
Sep 10 15:32:39.044478 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:39.044442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:39.256373 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:39.256287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:39.256373 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:39.256345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:39.256593 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:39.256464    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:32:39.256593 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:39.256469    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:32:39.256593 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:39.256492    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c696c4f5b-drx9s: secret "image-registry-tls" not found
Sep 10 15:32:39.256899 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:39.256873    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls podName:0b995ff5-f42a-4fa3-8e00-d2f90a02decf nodeName:}" failed. No retries permitted until 2026-09-10 15:32:41.256756612 +0000 UTC m=+38.071832334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls") pod "image-registry-c696c4f5b-drx9s" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf") : secret "image-registry-tls" not found
Sep 10 15:32:39.257053 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:39.256914    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls podName:a2bdf391-fbbf-4277-a0df-48771809d7f2 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:41.25689107 +0000 UTC m=+38.071966802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls") pod "dns-default-8pvt4" (UID: "a2bdf391-fbbf-4277-a0df-48771809d7f2") : secret "dns-default-metrics-tls" not found
Sep 10 15:32:39.347441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:39.347402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:39.412174 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:39.412135    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:41.274032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:41.274001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:41.274653 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:41.274045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:41.274653 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:41.274153    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:32:41.274653 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:41.274161    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:32:41.274653 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:41.274182    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c696c4f5b-drx9s: secret "image-registry-tls" not found
Sep 10 15:32:41.274653 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:41.274213    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls podName:a2bdf391-fbbf-4277-a0df-48771809d7f2 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:45.274194212 +0000 UTC m=+42.089269957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls") pod "dns-default-8pvt4" (UID: "a2bdf391-fbbf-4277-a0df-48771809d7f2") : secret "dns-default-metrics-tls" not found
Sep 10 15:32:41.274653 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:41.274231    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls podName:0b995ff5-f42a-4fa3-8e00-d2f90a02decf nodeName:}" failed. No retries permitted until 2026-09-10 15:32:45.274224894 +0000 UTC m=+42.089300616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls") pod "image-registry-c696c4f5b-drx9s" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf") : secret "image-registry-tls" not found
Sep 10 15:32:42.697564 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:42.697528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:42.754727 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:42.754693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:42.999581 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:42.999498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7kl4j" event={"ID":"c1e17b5c-42fa-4eec-b61a-2eb94a534625","Type":"ContainerStarted","Data":"445744a73a8577220ce138194b46067fd00a64e3d086e226b5add6fb72a72378"}
Sep 10 15:32:43.002294 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:43.002271    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b" containerID="fbab1641b4416c41fbf778e0935cd65388e54d64a0ed1a25e8088b949a9cd895" exitCode=0
Sep 10 15:32:43.002404 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:43.002317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerDied","Data":"fbab1641b4416c41fbf778e0935cd65388e54d64a0ed1a25e8088b949a9cd895"}
Sep 10 15:32:43.022597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:43.022549    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7kl4j" podStartSLOduration=1.8667893 podStartE2EDuration="6.022533361s" totalImagesPullingTime="4.155744061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:43.022096465 +0000 UTC m=+39.837172217" watchObservedRunningTime="2026-09-10 15:32:43.022533361 +0000 UTC m=+39.837609108"
Sep 10 15:32:44.007768 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:44.007726    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b" containerID="82285c0781a11901dd5b9404d25b92591d033d13691dbf1121b2b12dfa6b5747" exitCode=0
Sep 10 15:32:44.008145 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:44.007808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerDied","Data":"82285c0781a11901dd5b9404d25b92591d033d13691dbf1121b2b12dfa6b5747"}
Sep 10 15:32:44.404095 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:44.401943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:44.500786 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:44.500750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:45.013343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.013310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" event={"ID":"ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b","Type":"ContainerStarted","Data":"8983888d679b50d3b740ed990ebc40321e7ad387935dab244098b7ef55f7ec27"}
Sep 10 15:32:45.033906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.033852    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f6ncl" podStartSLOduration=9.513715202 podStartE2EDuration="42.033838526s" totalImagesPullingTime="32.520123324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:32:45.032145404 +0000 UTC m=+41.847221144" watchObservedRunningTime="2026-09-10 15:32:45.033838526 +0000 UTC m=+41.848914265"
Sep 10 15:32:45.153094 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.153049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:45.206895 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.206859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:45.307085 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.307014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:45.307085 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.307051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:45.307219 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:45.307145    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:32:45.307219 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:45.307155    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:32:45.307219 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:45.307174    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c696c4f5b-drx9s: secret "image-registry-tls" not found
Sep 10 15:32:45.307219 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:45.307212    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls podName:a2bdf391-fbbf-4277-a0df-48771809d7f2 nodeName:}" failed. No retries permitted until 2026-09-10 15:32:53.307199932 +0000 UTC m=+50.122275668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls") pod "dns-default-8pvt4" (UID: "a2bdf391-fbbf-4277-a0df-48771809d7f2") : secret "dns-default-metrics-tls" not found
Sep 10 15:32:45.307375 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:45.307292    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls podName:0b995ff5-f42a-4fa3-8e00-d2f90a02decf nodeName:}" failed. No retries permitted until 2026-09-10 15:32:53.30726977 +0000 UTC m=+50.122345492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls") pod "image-registry-c696c4f5b-drx9s" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf") : secret "image-registry-tls" not found
Sep 10 15:32:45.389643 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.389613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:45.746251 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.746219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:45.847202 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:45.847170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:47.305128 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:47.305088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:47.588528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:47.588443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:47.654255 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:47.654231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:53.363454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:53.363393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:32:53.363894 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:53.363463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:32:53.363894 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:53.363547    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:32:53.363894 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:53.363574    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c696c4f5b-drx9s: secret "image-registry-tls" not found
Sep 10 15:32:53.363894 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:53.363635    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls podName:0b995ff5-f42a-4fa3-8e00-d2f90a02decf nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.363616576 +0000 UTC m=+66.178692294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls") pod "image-registry-c696c4f5b-drx9s" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf") : secret "image-registry-tls" not found
Sep 10 15:32:53.363894 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:53.363557    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:32:53.363894 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:32:53.363680    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls podName:a2bdf391-fbbf-4277-a0df-48771809d7f2 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.363667113 +0000 UTC m=+66.178742842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls") pod "dns-default-8pvt4" (UID: "a2bdf391-fbbf-4277-a0df-48771809d7f2") : secret "dns-default-metrics-tls" not found
Sep 10 15:32:55.831692 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:55.831657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:59.233366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:59.233331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:59.326431 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:59.326388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:59.436784 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:59.436746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:32:59.536900 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:32:59.536828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:00.171133 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:00.171093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:00.272474 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:00.272438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:00.865810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:00.865773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:01.241748 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:01.241707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:01.342956 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:01.342922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:01.631330 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:01.631249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:02.977357 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:02.977330    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sm2lv"
Sep 10 15:33:03.134919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:03.134887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:03.189470 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:03.189434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:05.617663 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.617630    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"]
Sep 10 15:33:05.621590 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.621571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.624098 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.624068    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 15:33:05.624190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.624132    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 15:33:05.624190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.624132    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:33:05.624278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.624190    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5lp75\""
Sep 10 15:33:05.624278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.624231    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 15:33:05.632818 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.632801    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"]
Sep 10 15:33:05.635187 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.635170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a01fa180-3e1e-4f71-a28b-4af0c406be76-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.635268 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.635193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz7dr\" (UniqueName: \"kubernetes.io/projected/a01fa180-3e1e-4f71-a28b-4af0c406be76-kube-api-access-jz7dr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.635268 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.635219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a01fa180-3e1e-4f71-a28b-4af0c406be76-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.701781 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.701756    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"]
Sep 10 15:33:05.704289 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.704272    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-lqcpb"]
Sep 10 15:33:05.704405 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.704388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.706816 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.706800    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"]
Sep 10 15:33:05.706916 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.706902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.709372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.709357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:05.711440 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.711425    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 15:33:05.712535 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.712509    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 15:33:05.712741 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.712722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 15:33:05.712741 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.712737    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 15:33:05.712865 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.712744    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:33:05.712865 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.712778    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 15:33:05.712865 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.712737    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 15:33:05.713007 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.712992    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 15:33:05.713086 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.713072    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 15:33:05.713150 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.713091    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hwd8n\""
Sep 10 15:33:05.713150 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.713100    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2lvzg\""
Sep 10 15:33:05.713150 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.713095    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 15:33:05.713391 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.713376    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 15:33:05.713535 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.713521    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-96sw8\""
Sep 10 15:33:05.717643 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.717626    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 15:33:05.721648 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.721626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"]
Sep 10 15:33:05.722520 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.722501    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-lqcpb"]
Sep 10 15:33:05.724354 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.724335    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"]
Sep 10 15:33:05.736132 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-snapshots\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.736228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a01fa180-3e1e-4f71-a28b-4af0c406be76-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.736228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz7dr\" (UniqueName: \"kubernetes.io/projected/a01fa180-3e1e-4f71-a28b-4af0c406be76-kube-api-access-jz7dr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.736228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-tmp\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.736389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a01fa180-3e1e-4f71-a28b-4af0c406be76-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.736389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tcj5\" (UniqueName: \"kubernetes.io/projected/10827a10-4f3b-4daf-a8d8-7454d7086822-kube-api-access-2tcj5\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:05.736389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.736389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.736389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.736389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-serving-cert\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.736623 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:05.736623 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ztqn\" (UniqueName: \"kubernetes.io/projected/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-kube-api-access-8ztqn\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.736623 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.736623 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5ms9\" (UniqueName: \"kubernetes.io/projected/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-kube-api-access-v5ms9\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.736748 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.736706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a01fa180-3e1e-4f71-a28b-4af0c406be76-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.739257 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.739238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a01fa180-3e1e-4f71-a28b-4af0c406be76-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.751150 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.751128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz7dr\" (UniqueName: \"kubernetes.io/projected/a01fa180-3e1e-4f71-a28b-4af0c406be76-kube-api-access-jz7dr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-v92gt\" (UID: \"a01fa180-3e1e-4f71-a28b-4af0c406be76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.794356 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.794329    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8646695894-4pgll"]
Sep 10 15:33:05.797231 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.797213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.799714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.799699    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 15:33:05.799714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.799704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 15:33:05.799714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.799723    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4zmlt\""
Sep 10 15:33:05.800015 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.799991    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 15:33:05.800071 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.800019    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 15:33:05.800193 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.800181    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 15:33:05.800237 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.800192    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 15:33:05.810546 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.810530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8646695894-4pgll"]
Sep 10 15:33:05.837285 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.837388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.837388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.837388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:05.837525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-default-certificate\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.837525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ztqn\" (UniqueName: \"kubernetes.io/projected/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-kube-api-access-8ztqn\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.837525 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:05.837441    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:33:05.837525 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:05.837514    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls podName:10827a10-4f3b-4daf-a8d8-7454d7086822 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:06.337496212 +0000 UTC m=+63.152571946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pqrf5" (UID: "10827a10-4f3b-4daf-a8d8-7454d7086822") : secret "samples-operator-tls" not found
Sep 10 15:33:05.837700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcj5\" (UniqueName: \"kubernetes.io/projected/10827a10-4f3b-4daf-a8d8-7454d7086822-kube-api-access-2tcj5\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:05.837700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.837700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-serving-cert\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.837700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.837700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5ms9\" (UniqueName: \"kubernetes.io/projected/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-kube-api-access-v5ms9\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.837911 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:05.837818    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:05.837911 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:05.837864    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls podName:86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:06.337850001 +0000 UTC m=+63.152925720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8t5kw" (UID: "86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:05.837911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.837911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837903    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.838129 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.837982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-stats-auth\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.838129 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.838010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkkqq\" (UniqueName: \"kubernetes.io/projected/6ee431f4-2197-4401-94bb-3810063e3595-kube-api-access-hkkqq\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.838129 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.838036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-snapshots\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.838252 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.838140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-tmp\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.838252 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.838192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.838437 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.838417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.838577 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.838562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-snapshots\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.838637 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.838563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-tmp\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.839887 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.839861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-serving-cert\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.845523 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.845499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ztqn\" (UniqueName: \"kubernetes.io/projected/6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2-kube-api-access-8ztqn\") pod \"insights-operator-76bcd6ccf5-lqcpb\" (UID: \"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:05.845724 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.845706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5ms9\" (UniqueName: \"kubernetes.io/projected/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-kube-api-access-v5ms9\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:05.845994 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.845953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tcj5\" (UniqueName: \"kubernetes.io/projected/10827a10-4f3b-4daf-a8d8-7454d7086822-kube-api-access-2tcj5\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:05.917356 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.917333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:05.930126 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.930110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"
Sep 10 15:33:05.939023 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.939006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.939091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.939033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-stats-auth\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.939091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.939050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkkqq\" (UniqueName: \"kubernetes.io/projected/6ee431f4-2197-4401-94bb-3810063e3595-kube-api-access-hkkqq\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.939180 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:05.939166    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:06.439150583 +0000 UTC m=+63.254226304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : configmap references non-existent config key: service-ca.crt
Sep 10 15:33:05.939267 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.939249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.939355 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.939333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-default-certificate\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.939440 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:05.939423    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:33:05.939508 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:05.939498    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:06.439481081 +0000 UTC m=+63.254556817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : secret "router-metrics-certs-default" not found
Sep 10 15:33:05.941345 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.941322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-stats-auth\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.941580 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.941562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-default-certificate\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:05.946978 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:05.946939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkkqq\" (UniqueName: \"kubernetes.io/projected/6ee431f4-2197-4401-94bb-3810063e3595-kube-api-access-hkkqq\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:06.019479 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:06.019454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb"
Sep 10 15:33:06.019665 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:06.019639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:06.195246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:06.195173    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt"]
Sep 10 15:33:06.198008 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:06.197980    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01fa180_3e1e_4f71_a28b_4af0c406be76.slice/crio-0ba5594f841bbe12338707335303f1c5e325e8d200cc898d460fe87ff34e3bef WatchSource:0}: Error finding container 0ba5594f841bbe12338707335303f1c5e325e8d200cc898d460fe87ff34e3bef: Status 404 returned error can't find the container with id 0ba5594f841bbe12338707335303f1c5e325e8d200cc898d460fe87ff34e3bef
Sep 10 15:33:06.286130 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:06.286100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-lqcpb"]
Sep 10 15:33:06.288759 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:06.288736    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba258b6_95b5_4dd0_8cc8_7f4ec430f1e2.slice/crio-8099685b027824bcde55f9594743d45143437bd29ee102d5db1781fe40a7ab72 WatchSource:0}: Error finding container 8099685b027824bcde55f9594743d45143437bd29ee102d5db1781fe40a7ab72: Status 404 returned error can't find the container with id 8099685b027824bcde55f9594743d45143437bd29ee102d5db1781fe40a7ab72
Sep 10 15:33:06.342930 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:06.342902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:06.343042 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:06.343011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:06.343085 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:06.343064    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:06.343133 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:06.343123    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls podName:86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:07.343104062 +0000 UTC m=+64.158179784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8t5kw" (UID: "86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:06.343133 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:06.343130    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:33:06.343206 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:06.343170    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls podName:10827a10-4f3b-4daf-a8d8-7454d7086822 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:07.343155597 +0000 UTC m=+64.158231340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pqrf5" (UID: "10827a10-4f3b-4daf-a8d8-7454d7086822") : secret "samples-operator-tls" not found
Sep 10 15:33:06.443483 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:06.443455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:06.443612 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:06.443568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:06.443612 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:06.443603    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:33:06.443688 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:06.443660    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:07.443645607 +0000 UTC m=+64.258721327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : secret "router-metrics-certs-default" not found
Sep 10 15:33:06.443688 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:06.443674    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:07.443667987 +0000 UTC m=+64.258743709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : configmap references non-existent config key: service-ca.crt
Sep 10 15:33:07.066354 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:07.066314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb" event={"ID":"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2","Type":"ContainerStarted","Data":"8099685b027824bcde55f9594743d45143437bd29ee102d5db1781fe40a7ab72"}
Sep 10 15:33:07.067709 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:07.067678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt" event={"ID":"a01fa180-3e1e-4f71-a28b-4af0c406be76","Type":"ContainerStarted","Data":"0ba5594f841bbe12338707335303f1c5e325e8d200cc898d460fe87ff34e3bef"}
Sep 10 15:33:07.352339 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:07.352244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:07.352503 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:07.352387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:07.352503 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:07.352416    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:07.352503 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:07.352494    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls podName:86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.352470401 +0000 UTC m=+66.167546147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8t5kw" (UID: "86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:07.352668 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:07.352550    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:33:07.352668 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:07.352606    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls podName:10827a10-4f3b-4daf-a8d8-7454d7086822 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.352594253 +0000 UTC m=+66.167669976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pqrf5" (UID: "10827a10-4f3b-4daf-a8d8-7454d7086822") : secret "samples-operator-tls" not found
Sep 10 15:33:07.453742 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:07.453702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:07.453909 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:07.453843    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:33:07.453909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:07.453864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:07.454053 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:07.453910    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.453895262 +0000 UTC m=+66.268971003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : secret "router-metrics-certs-default" not found
Sep 10 15:33:07.454053 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:07.454009    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:09.453993059 +0000 UTC m=+66.269068780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : configmap references non-existent config key: service-ca.crt
Sep 10 15:33:09.075171 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.075134    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb" event={"ID":"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2","Type":"ContainerStarted","Data":"9f35c122341b559f69fcdb2a24cc356280c6ee9b154876db0eef014429079193"}
Sep 10 15:33:09.076748 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.076723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt" event={"ID":"a01fa180-3e1e-4f71-a28b-4af0c406be76","Type":"ContainerStarted","Data":"a84b6ed2e50f455db7c8a7fc23c69339effd2bb323e7f43f179e91003776cb40"}
Sep 10 15:33:09.093795 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.093744    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb" podStartSLOduration=1.906882859 podStartE2EDuration="4.093730711s" totalImagesPullingTime="2.186847852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:09.092117386 +0000 UTC m=+65.907193118" watchObservedRunningTime="2026-09-10 15:33:09.093730711 +0000 UTC m=+65.908806463"
Sep 10 15:33:09.106607 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.106562    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt" podStartSLOduration=1.831444351 podStartE2EDuration="4.106550367s" totalImagesPullingTime="2.275106016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:09.106149079 +0000 UTC m=+65.921224847" watchObservedRunningTime="2026-09-10 15:33:09.106550367 +0000 UTC m=+65.921626107"
Sep 10 15:33:09.264889 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.264850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:09.364943 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.364866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:09.367812 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.367780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:09.367894 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.367833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:33:09.367894 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.367868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:33:09.368008 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.367908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:09.368008 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.367910    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:09.368008 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.367999    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 15:33:09.368153 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.368003    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 15:33:09.368153 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.368027    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c696c4f5b-drx9s: secret "image-registry-tls" not found
Sep 10 15:33:09.368153 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.367955    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:33:09.368153 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.368046    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls podName:86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:13.368027668 +0000 UTC m=+70.183103412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8t5kw" (UID: "86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:09.368153 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.368060    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls podName:a2bdf391-fbbf-4277-a0df-48771809d7f2 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:41.368054027 +0000 UTC m=+98.183129745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls") pod "dns-default-8pvt4" (UID: "a2bdf391-fbbf-4277-a0df-48771809d7f2") : secret "dns-default-metrics-tls" not found
Sep 10 15:33:09.368153 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.368094    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls podName:0b995ff5-f42a-4fa3-8e00-d2f90a02decf nodeName:}" failed. No retries permitted until 2026-09-10 15:33:41.368077376 +0000 UTC m=+98.183153100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls") pod "image-registry-c696c4f5b-drx9s" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf") : secret "image-registry-tls" not found
Sep 10 15:33:09.368153 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.368112    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls podName:10827a10-4f3b-4daf-a8d8-7454d7086822 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:13.368102067 +0000 UTC m=+70.183177790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pqrf5" (UID: "10827a10-4f3b-4daf-a8d8-7454d7086822") : secret "samples-operator-tls" not found
Sep 10 15:33:09.469154 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.469112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:33:09.469287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.469185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:09.469287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.469243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:09.469386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.469286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:33:09.469386 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.469330    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:33:09.469386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.469335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:33:09.469386 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.469362    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:13.46934839 +0000 UTC m=+70.284424112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : configmap references non-existent config key: service-ca.crt
Sep 10 15:33:09.469573 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.469394    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:13.469379701 +0000 UTC m=+70.284455425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : secret "router-metrics-certs-default" not found
Sep 10 15:33:09.471819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.471780    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 15:33:09.471938 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.471831    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 15:33:09.471938 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.471843    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 15:33:09.479505 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.479482    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 15:33:09.479603 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.479552    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs podName:b48c88a3-d212-47b7-bb49-118f3d58fb3d nodeName:}" failed. No retries permitted until 2026-09-10 15:34:13.479536359 +0000 UTC m=+130.294612083 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs") pod "network-metrics-daemon-5qpdw" (UID: "b48c88a3-d212-47b7-bb49-118f3d58fb3d") : secret "metrics-daemon-secret" not found
Sep 10 15:33:09.481420 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.481398    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 15:33:09.481540 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.481519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb44b5c1-8d56-4e63-80da-38fa93d65001-original-pull-secret\") pod \"global-pull-secret-syncer-4qndm\" (UID: \"cb44b5c1-8d56-4e63-80da-38fa93d65001\") " pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:33:09.492390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.492364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g457j\" (UniqueName: \"kubernetes.io/projected/8ad37576-881a-466a-8501-67ef976a2005-kube-api-access-g457j\") pod \"network-check-target-dx4hr\" (UID: \"8ad37576-881a-466a-8501-67ef976a2005\") " pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:33:09.731980 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.731926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qndm"
Sep 10 15:33:09.744892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.744862    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-skj7z\""
Sep 10 15:33:09.751093 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.751072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:33:09.776221 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.776192    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gfrlj"]
Sep 10 15:33:09.779775 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.779752    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.782447 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.782389    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cj5pp\""
Sep 10 15:33:09.783263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.782666    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 15:33:09.783263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.782835    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 15:33:09.797047 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.797017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:09.813909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.812202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gfrlj"]
Sep 10 15:33:09.873603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.873565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.873744 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.873609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-crio-socket\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.873744 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.873646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-data-volume\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.873744 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.873719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2vtz\" (UniqueName: \"kubernetes.io/projected/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-api-access-h2vtz\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.873929 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.873769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.875006 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.874973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:09.973384 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.973353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:09.974247 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.974223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.974345 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.974259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-crio-socket\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.974345 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.974317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-data-volume\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.974461 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.974353    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:09.974461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.974363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vtz\" (UniqueName: \"kubernetes.io/projected/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-api-access-h2vtz\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.974461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.974383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-crio-socket\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.974461 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.974414    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:10.474395679 +0000 UTC m=+67.289471424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:09.974461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.974451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.974672 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.974534    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:33:09.974672 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:09.974567    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:10.474555937 +0000 UTC m=+67.289631675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : configmap "kube-rbac-proxy" not found
Sep 10 15:33:09.974672 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.974658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-data-volume\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:09.984860 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:09.984810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2vtz\" (UniqueName: \"kubernetes.io/projected/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-api-access-h2vtz\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:10.010887 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:10.010865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qndm"]
Sep 10 15:33:10.014973 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:10.014942    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb44b5c1_8d56_4e63_80da_38fa93d65001.slice/crio-364801addcdd869f1648f3bbcd64701336c387618cdc930b19dc17f205531592 WatchSource:0}: Error finding container 364801addcdd869f1648f3bbcd64701336c387618cdc930b19dc17f205531592: Status 404 returned error can't find the container with id 364801addcdd869f1648f3bbcd64701336c387618cdc930b19dc17f205531592
Sep 10 15:33:10.040704 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:10.040683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dx4hr"]
Sep 10 15:33:10.043094 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:10.043076    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad37576_881a_466a_8501_67ef976a2005.slice/crio-079d5886bac1bea66b2002766dc41d3c83d54bb2ae00e2456370cade8b631f18 WatchSource:0}: Error finding container 079d5886bac1bea66b2002766dc41d3c83d54bb2ae00e2456370cade8b631f18: Status 404 returned error can't find the container with id 079d5886bac1bea66b2002766dc41d3c83d54bb2ae00e2456370cade8b631f18
Sep 10 15:33:10.080111 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:10.080079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dx4hr" event={"ID":"8ad37576-881a-466a-8501-67ef976a2005","Type":"ContainerStarted","Data":"079d5886bac1bea66b2002766dc41d3c83d54bb2ae00e2456370cade8b631f18"}
Sep 10 15:33:10.081232 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:10.081209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qndm" event={"ID":"cb44b5c1-8d56-4e63-80da-38fa93d65001","Type":"ContainerStarted","Data":"364801addcdd869f1648f3bbcd64701336c387618cdc930b19dc17f205531592"}
Sep 10 15:33:10.478942 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:10.478903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:10.479140 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:10.479052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:10.479140 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:10.479056    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:33:10.479140 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:10.479133    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:11.479112674 +0000 UTC m=+68.294188416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : configmap "kube-rbac-proxy" not found
Sep 10 15:33:10.479333 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:10.479155    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:10.479333 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:10.479207    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:11.479189142 +0000 UTC m=+68.294264874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:11.108387 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:11.108352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8rbvn_8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20/dns-node-resolver/0.log"
Sep 10 15:33:11.473154 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:11.473122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:11.487437 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:11.487399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:11.487572 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:11.487525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:11.487617 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:11.487562    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:33:11.487658 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:11.487631    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:13.487612094 +0000 UTC m=+70.302687833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : configmap "kube-rbac-proxy" not found
Sep 10 15:33:11.487723 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:11.487657    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:11.487723 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:11.487707    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:13.487691378 +0000 UTC m=+70.302767102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:11.571503 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:11.571447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:11.830647 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:11.830559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:11.890575 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:11.890535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:12.508543 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:12.508511    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s2ccc_04488ced-232c-417b-9ec1-023c34e2a130/node-ca/0.log"
Sep 10 15:33:12.710414 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:12.710376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:12.812678 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:12.812504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:12.908230 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:12.908070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7kl4j_c1e17b5c-42fa-4eec-b61a-2eb94a534625/serve-healthcheck-canary/0.log"
Sep 10 15:33:13.090274 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.090200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dx4hr" event={"ID":"8ad37576-881a-466a-8501-67ef976a2005","Type":"ContainerStarted","Data":"0370dfd2efd6326074d6ed11ba7befbe991ef2cf4e20387bfbd0364a78536c81"}
Sep 10 15:33:13.090395 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.090302    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:33:13.106729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.106686    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dx4hr" podStartSLOduration=67.174615062 podStartE2EDuration="1m10.106674774s" totalImagesPullingTime="2.932059712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:13.105606012 +0000 UTC m=+69.920681751" watchObservedRunningTime="2026-09-10 15:33:13.106674774 +0000 UTC m=+69.921750510"
Sep 10 15:33:13.145067 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.145028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:13.204006 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.203940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:13.403996 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.403953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:13.404174 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.404082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:13.404174 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.404122    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:13.404285 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.404200    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls podName:86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:21.404179786 +0000 UTC m=+78.219255526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8t5kw" (UID: "86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:13.404285 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.404224    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 15:33:13.404285 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.404281    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls podName:10827a10-4f3b-4daf-a8d8-7454d7086822 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:21.404262704 +0000 UTC m=+78.219338493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pqrf5" (UID: "10827a10-4f3b-4daf-a8d8-7454d7086822") : secret "samples-operator-tls" not found
Sep 10 15:33:13.429616 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.429564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:13.504772 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.504740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:13.504932 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.504798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:13.504932 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.504898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:13.504932 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.504911    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:33:13.504932 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.504923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:13.505181 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.504939    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:33:13.505181 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.505000    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:21.504978275 +0000 UTC m=+78.320054013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : secret "router-metrics-certs-default" not found
Sep 10 15:33:13.505181 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.505072    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:13.505181 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.505082    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:17.505070351 +0000 UTC m=+74.320146075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : configmap "kube-rbac-proxy" not found
Sep 10 15:33:13.505181 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.505098    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:21.505089197 +0000 UTC m=+78.320164918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : configmap references non-existent config key: service-ca.crt
Sep 10 15:33:13.505181 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:13.505115    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:17.505106838 +0000 UTC m=+74.320182559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:13.525443 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:13.525414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:15.073469 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:15.073438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:15.097289 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:15.097257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qndm" event={"ID":"cb44b5c1-8d56-4e63-80da-38fa93d65001","Type":"ContainerStarted","Data":"9ed4b9a1841da0ede89906057573812f515c58a51bb2b988d7f41993bdd8f0b2"}
Sep 10 15:33:15.111916 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:15.111865    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4qndm" podStartSLOduration=66.208074804 podStartE2EDuration="1m11.111832062s" totalImagesPullingTime="4.903757258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:15.111255187 +0000 UTC m=+71.926330924" watchObservedRunningTime="2026-09-10 15:33:15.111832062 +0000 UTC m=+71.926907800"
Sep 10 15:33:15.301995 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:15.301897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:15.401603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:15.401569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:16.011337 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:16.011300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:17.284565 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:17.284527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:17.535093 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:17.535020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:17.535222 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:17.535096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:17.535222 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:17.535127    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 15:33:17.535222 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:17.535190    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:25.535172718 +0000 UTC m=+82.350248435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : configmap "kube-rbac-proxy" not found
Sep 10 15:33:17.535222 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:17.535211    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:17.535354 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:17.535252    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:25.535237568 +0000 UTC m=+82.350313286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:17.753532 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:17.753497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:19.009916 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:19.009878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:19.876218 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:19.876185    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:20.148016 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:20.147924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:20.209337 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:20.209303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:20.271712 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:20.271680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:20.372109 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:20.372078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:20.480444 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:20.480414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:20.573550 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:20.573514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:21.464876 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.464833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:21.465306 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.464952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:21.465306 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:21.464978    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:21.465306 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:21.465039    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls podName:86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:37.465024736 +0000 UTC m=+94.280100454 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8t5kw" (UID: "86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8") : secret "cluster-monitoring-operator-tls" not found
Sep 10 15:33:21.467409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.467392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/10827a10-4f3b-4daf-a8d8-7454d7086822-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pqrf5\" (UID: \"10827a10-4f3b-4daf-a8d8-7454d7086822\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:21.561890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.561858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:21.565909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.565887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:21.565980 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.565951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:21.566064 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:21.566051    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 15:33:21.566099 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:21.566053    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:37.566037048 +0000 UTC m=+94.381112766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : configmap references non-existent config key: service-ca.crt
Sep 10 15:33:21.566141 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:21.566114    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs podName:6ee431f4-2197-4401-94bb-3810063e3595 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:37.566101569 +0000 UTC m=+94.381177287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs") pod "router-default-8646695894-4pgll" (UID: "6ee431f4-2197-4401-94bb-3810063e3595") : secret "router-metrics-certs-default" not found
Sep 10 15:33:21.626567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.626535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"
Sep 10 15:33:21.758984 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.758871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:21.892654 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:21.892618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5"]
Sep 10 15:33:22.120452 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:22.120369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5" event={"ID":"10827a10-4f3b-4daf-a8d8-7454d7086822","Type":"ContainerStarted","Data":"94812c2b3a7b6c42d1b70009419adbe7444c94b19f4205e7928993d6c4675cc6"}
Sep 10 15:33:22.167060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:22.167030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:22.357197 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:22.357165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:22.944875 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:22.944829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:22.998776 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:22.998736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:23.359219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:23.359130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:23.562811 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:23.562777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:23.672681 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:23.672652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:23.772314 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:23.772276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:24.131584 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:24.131545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5" event={"ID":"10827a10-4f3b-4daf-a8d8-7454d7086822","Type":"ContainerStarted","Data":"d017497d0a329205af143eec683874009c3934829fadb69805cf3c8ee4696930"}
Sep 10 15:33:24.131949 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:24.131600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5" event={"ID":"10827a10-4f3b-4daf-a8d8-7454d7086822","Type":"ContainerStarted","Data":"7347740c7d7bf75fbe4f9eb277a3a564fc4f8f781d3a697defbfe09efa89fc4d"}
Sep 10 15:33:24.149346 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:24.149301    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pqrf5" podStartSLOduration=17.224594019 podStartE2EDuration="19.149285463s" totalImagesPullingTime="1.924691444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:24.148234465 +0000 UTC m=+80.963310205" watchObservedRunningTime="2026-09-10 15:33:24.149285463 +0000 UTC m=+80.964361202"
Sep 10 15:33:24.159183 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:24.159155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:24.566935 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:24.566895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:24.637219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:24.637188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:24.761351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:24.761317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:25.158765 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:25.158733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:25.600068 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:25.599992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:25.600068 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:25.600054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:25.600246 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:25.600130    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:25.600246 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:25.600191    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls podName:c6af7b99-dc7d-49b1-9ae3-976ee78d7044 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:41.600174687 +0000 UTC m=+98.415250405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gfrlj" (UID: "c6af7b99-dc7d-49b1-9ae3-976ee78d7044") : secret "insights-runtime-extractor-tls" not found
Sep 10 15:33:25.600481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:25.600466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:25.752935 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:25.752892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:26.158819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:26.158301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:26.223445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:26.223416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:26.366287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:26.366258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:26.965219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:26.965186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:27.558503 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:27.558467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:27.765480 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:27.765439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:27.880851 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:27.880758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:28.162908 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:28.162881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:28.382376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:28.382336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:28.755487 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:28.755447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:29.362209 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:29.362175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:29.759785 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:29.759734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:30.158176 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:30.158139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:30.368827 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:30.368784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:30.562532 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:30.562445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:32.583176 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:32.583139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:32.639034 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:32.638999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:33.215718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:33.215677    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:33.315627 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:33.315595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:33.377454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:33.377426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:33.522223 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:33.522109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:33.698069 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:33.698032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:33.892831 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:33.892747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:33.954849 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:33.954813    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:34.091191 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:34.091151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:34.490697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:34.490663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:34.591519 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:34.591493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:35.098778 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:35.098745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:35.305352 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:35.305320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:35.359157 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:35.359078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:35.926848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:35.926812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:35.981539 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:35.981511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:37.498511 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.498469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:37.501007 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.500985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8t5kw\" (UID: \"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:37.512886 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.512858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"
Sep 10 15:33:37.599700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.599670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:37.599817 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.599772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:37.600368 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.600347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ee431f4-2197-4401-94bb-3810063e3595-service-ca-bundle\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:37.601844 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.601822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee431f4-2197-4401-94bb-3810063e3595-metrics-certs\") pod \"router-default-8646695894-4pgll\" (UID: \"6ee431f4-2197-4401-94bb-3810063e3595\") " pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:37.605729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.605710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:37.779809 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.779785    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw"]
Sep 10 15:33:37.781988 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:37.781942    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86cdaaa5_74fd_4e44_aa6f_39bdbc5f1fc8.slice/crio-3d44b18d3a200b7332f6961be1a338135c2e36c607fd58bfecd09606473af1e1 WatchSource:0}: Error finding container 3d44b18d3a200b7332f6961be1a338135c2e36c607fd58bfecd09606473af1e1: Status 404 returned error can't find the container with id 3d44b18d3a200b7332f6961be1a338135c2e36c607fd58bfecd09606473af1e1
Sep 10 15:33:37.897890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:37.897869    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8646695894-4pgll"]
Sep 10 15:33:37.899932 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:37.899907    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee431f4_2197_4401_94bb_3810063e3595.slice/crio-660b30194946ec46428202202b367a31e365076de618af6454e9df6d414dfde7 WatchSource:0}: Error finding container 660b30194946ec46428202202b367a31e365076de618af6454e9df6d414dfde7: Status 404 returned error can't find the container with id 660b30194946ec46428202202b367a31e365076de618af6454e9df6d414dfde7
Sep 10 15:33:38.174732 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.174696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8646695894-4pgll" event={"ID":"6ee431f4-2197-4401-94bb-3810063e3595","Type":"ContainerStarted","Data":"90fd13ed3e36f700a6c4f5c0ba9aa0cc154503561e3d3cf8ef4a0172fc3cd499"}
Sep 10 15:33:38.174929 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.174753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8646695894-4pgll" event={"ID":"6ee431f4-2197-4401-94bb-3810063e3595","Type":"ContainerStarted","Data":"660b30194946ec46428202202b367a31e365076de618af6454e9df6d414dfde7"}
Sep 10 15:33:38.175914 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.175888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw" event={"ID":"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8","Type":"ContainerStarted","Data":"3d44b18d3a200b7332f6961be1a338135c2e36c607fd58bfecd09606473af1e1"}
Sep 10 15:33:38.193648 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.193606    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8646695894-4pgll" podStartSLOduration=33.193592615 podStartE2EDuration="33.193592615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:38.191836671 +0000 UTC m=+95.006912412" watchObservedRunningTime="2026-09-10 15:33:38.193592615 +0000 UTC m=+95.008668354"
Sep 10 15:33:38.606253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.606168    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:38.609121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.609093    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:38.833758 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.833727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"]
Sep 10 15:33:38.839470 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.839444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"
Sep 10 15:33:38.843162 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.843122    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 15:33:38.843162 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.843140    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 15:33:38.843342 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.843171    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 15:33:38.843458 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.843437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8pkcm\""
Sep 10 15:33:38.847946 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.847924    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 15:33:38.863142 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.863076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"]
Sep 10 15:33:38.909645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.909607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpfnp\" (UniqueName: \"kubernetes.io/projected/f9a94eed-f38e-404f-8f3d-07977db6c8be-kube-api-access-fpfnp\") pod \"managed-serviceaccount-addon-agent-66b8996546-k58nr\" (UID: \"f9a94eed-f38e-404f-8f3d-07977db6c8be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"
Sep 10 15:33:38.909809 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:38.909692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9a94eed-f38e-404f-8f3d-07977db6c8be-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66b8996546-k58nr\" (UID: \"f9a94eed-f38e-404f-8f3d-07977db6c8be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"
Sep 10 15:33:39.010740 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.010698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9a94eed-f38e-404f-8f3d-07977db6c8be-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66b8996546-k58nr\" (UID: \"f9a94eed-f38e-404f-8f3d-07977db6c8be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"
Sep 10 15:33:39.010914 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.010820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpfnp\" (UniqueName: \"kubernetes.io/projected/f9a94eed-f38e-404f-8f3d-07977db6c8be-kube-api-access-fpfnp\") pod \"managed-serviceaccount-addon-agent-66b8996546-k58nr\" (UID: \"f9a94eed-f38e-404f-8f3d-07977db6c8be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"
Sep 10 15:33:39.013778 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.013751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9a94eed-f38e-404f-8f3d-07977db6c8be-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66b8996546-k58nr\" (UID: \"f9a94eed-f38e-404f-8f3d-07977db6c8be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"
Sep 10 15:33:39.028836 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.028811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpfnp\" (UniqueName: \"kubernetes.io/projected/f9a94eed-f38e-404f-8f3d-07977db6c8be-kube-api-access-fpfnp\") pod \"managed-serviceaccount-addon-agent-66b8996546-k58nr\" (UID: \"f9a94eed-f38e-404f-8f3d-07977db6c8be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"
Sep 10 15:33:39.067913 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.067874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:39.158671 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.158644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"
Sep 10 15:33:39.162182 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.162128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:39.179338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.179313    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:39.181082 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.181062    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8646695894-4pgll"
Sep 10 15:33:39.260207 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.260173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:39.362430 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.362398    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:39.760596 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.760512    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr"]
Sep 10 15:33:39.764130 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:39.764095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9a94eed_f38e_404f_8f3d_07977db6c8be.slice/crio-2a8e60039f343fc9c27ebfbcaaaca7d94dcb98cb76f50a98f005d5ceba02bcc3 WatchSource:0}: Error finding container 2a8e60039f343fc9c27ebfbcaaaca7d94dcb98cb76f50a98f005d5ceba02bcc3: Status 404 returned error can't find the container with id 2a8e60039f343fc9c27ebfbcaaaca7d94dcb98cb76f50a98f005d5ceba02bcc3
Sep 10 15:33:39.862893 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.862859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:39.964422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:39.964383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:40.043039 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.042949    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"]
Sep 10 15:33:40.046119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.046098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"
Sep 10 15:33:40.048626 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.048607    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 15:33:40.048736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.048715    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9jzm5\""
Sep 10 15:33:40.056051 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.056022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"]
Sep 10 15:33:40.069545 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.069522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:40.119395 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.119366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/53231d4f-c522-4794-a1d3-bbd7f36f77c2-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-pmvkz\" (UID: \"53231d4f-c522-4794-a1d3-bbd7f36f77c2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"
Sep 10 15:33:40.183107 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.183074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:40.183358 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.183333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw" event={"ID":"86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8","Type":"ContainerStarted","Data":"257fcb287b7ab20502fffd8ee7dc7ab5ad8a2a276e46c31cfff0302075b186b9"}
Sep 10 15:33:40.184577 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.184556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr" event={"ID":"f9a94eed-f38e-404f-8f3d-07977db6c8be","Type":"ContainerStarted","Data":"2a8e60039f343fc9c27ebfbcaaaca7d94dcb98cb76f50a98f005d5ceba02bcc3"}
Sep 10 15:33:40.206453 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.206410    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8t5kw" podStartSLOduration=33.443578985 podStartE2EDuration="35.206396115s" totalImagesPullingTime="1.76281713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:40.205445795 +0000 UTC m=+97.020521562" watchObservedRunningTime="2026-09-10 15:33:40.206396115 +0000 UTC m=+97.021471853"
Sep 10 15:33:40.220090 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.220059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/53231d4f-c522-4794-a1d3-bbd7f36f77c2-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-pmvkz\" (UID: \"53231d4f-c522-4794-a1d3-bbd7f36f77c2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"
Sep 10 15:33:40.223121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.223088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/53231d4f-c522-4794-a1d3-bbd7f36f77c2-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-pmvkz\" (UID: \"53231d4f-c522-4794-a1d3-bbd7f36f77c2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"
Sep 10 15:33:40.355151 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.355059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"
Sep 10 15:33:40.639131 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:40.639038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"]
Sep 10 15:33:40.642627 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:40.642570    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53231d4f_c522_4794_a1d3_bbd7f36f77c2.slice/crio-79c227337359db5e9dee8d86da3ae897ec6f33dfe1210f54329f8ab328a9f908 WatchSource:0}: Error finding container 79c227337359db5e9dee8d86da3ae897ec6f33dfe1210f54329f8ab328a9f908: Status 404 returned error can't find the container with id 79c227337359db5e9dee8d86da3ae897ec6f33dfe1210f54329f8ab328a9f908
Sep 10 15:33:41.189672 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.189630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz" event={"ID":"53231d4f-c522-4794-a1d3-bbd7f36f77c2","Type":"ContainerStarted","Data":"79c227337359db5e9dee8d86da3ae897ec6f33dfe1210f54329f8ab328a9f908"}
Sep 10 15:33:41.432010 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.431971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:33:41.432201 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.432028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:33:41.434581 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.434552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2bdf391-fbbf-4277-a0df-48771809d7f2-metrics-tls\") pod \"dns-default-8pvt4\" (UID: \"a2bdf391-fbbf-4277-a0df-48771809d7f2\") " pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:33:41.434695 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.434606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"image-registry-c696c4f5b-drx9s\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") " pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:33:41.471985 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.471881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wjsnb\""
Sep 10 15:33:41.478968 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.478934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:33:41.494979 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.494942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bddbj\""
Sep 10 15:33:41.500055 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.500032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:33:41.633628 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.633586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:41.636041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.636016    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6af7b99-dc7d-49b1-9ae3-976ee78d7044-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gfrlj\" (UID: \"c6af7b99-dc7d-49b1-9ae3-976ee78d7044\") " pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:41.733412 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.733326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:41.896891 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:41.896855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gfrlj"
Sep 10 15:33:42.186765 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:42.186737    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8pvt4"]
Sep 10 15:33:42.191640 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:42.191573    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c696c4f5b-drx9s"]
Sep 10 15:33:42.195189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:42.195162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr" event={"ID":"f9a94eed-f38e-404f-8f3d-07977db6c8be","Type":"ContainerStarted","Data":"bf4957e00686399022e7a66d4fc7e21e1e7358bef76fed07c6a8b8f6e4a2a882"}
Sep 10 15:33:42.201118 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:42.201084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gfrlj"]
Sep 10 15:33:42.213933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:42.213887    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66b8996546-k58nr" podStartSLOduration=2.003086577 podStartE2EDuration="4.21387164s" totalImagesPullingTime="2.210785063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:42.213690761 +0000 UTC m=+99.028766501" watchObservedRunningTime="2026-09-10 15:33:42.21387164 +0000 UTC m=+99.028947374"
Sep 10 15:33:42.277409 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:42.277341    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bdf391_fbbf_4277_a0df_48771809d7f2.slice/crio-5532febffe3a70d37af0df5ffc34b9647086edffcd0ad335afc478415499a25b WatchSource:0}: Error finding container 5532febffe3a70d37af0df5ffc34b9647086edffcd0ad335afc478415499a25b: Status 404 returned error can't find the container with id 5532febffe3a70d37af0df5ffc34b9647086edffcd0ad335afc478415499a25b
Sep 10 15:33:42.278010 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:42.277988    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6af7b99_dc7d_49b1_9ae3_976ee78d7044.slice/crio-7e4600c7260f2dbb9ac134460325ca62fb3d2edd5ee4a16e554d1d76a238545d WatchSource:0}: Error finding container 7e4600c7260f2dbb9ac134460325ca62fb3d2edd5ee4a16e554d1d76a238545d: Status 404 returned error can't find the container with id 7e4600c7260f2dbb9ac134460325ca62fb3d2edd5ee4a16e554d1d76a238545d
Sep 10 15:33:42.278948 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:42.278913    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b995ff5_f42a_4fa3_8e00_d2f90a02decf.slice/crio-2cc86d0716f7edad97cdf70642f85d5ea5a3d32f9a5b34371d3421c78dc86b7d WatchSource:0}: Error finding container 2cc86d0716f7edad97cdf70642f85d5ea5a3d32f9a5b34371d3421c78dc86b7d: Status 404 returned error can't find the container with id 2cc86d0716f7edad97cdf70642f85d5ea5a3d32f9a5b34371d3421c78dc86b7d
Sep 10 15:33:43.200392 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.200359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pvt4" event={"ID":"a2bdf391-fbbf-4277-a0df-48771809d7f2","Type":"ContainerStarted","Data":"5532febffe3a70d37af0df5ffc34b9647086edffcd0ad335afc478415499a25b"}
Sep 10 15:33:43.202321 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.202285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s" event={"ID":"0b995ff5-f42a-4fa3-8e00-d2f90a02decf","Type":"ContainerStarted","Data":"5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e"}
Sep 10 15:33:43.202470 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.202336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s" event={"ID":"0b995ff5-f42a-4fa3-8e00-d2f90a02decf","Type":"ContainerStarted","Data":"2cc86d0716f7edad97cdf70642f85d5ea5a3d32f9a5b34371d3421c78dc86b7d"}
Sep 10 15:33:43.202470 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.202361    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:33:43.203945 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.203915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz" event={"ID":"53231d4f-c522-4794-a1d3-bbd7f36f77c2","Type":"ContainerStarted","Data":"1eb3175846f170f5f05d65d5718871a81c3faeee6cabb1b39031609a0eeaeb33"}
Sep 10 15:33:43.204087 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.204061    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"
Sep 10 15:33:43.205691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.205664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfrlj" event={"ID":"c6af7b99-dc7d-49b1-9ae3-976ee78d7044","Type":"ContainerStarted","Data":"45402ce72eb3ff7890a6e1f20083223482f73113d94ab8a74ded3bdc6b4b4ec3"}
Sep 10 15:33:43.205805 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.205721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfrlj" event={"ID":"c6af7b99-dc7d-49b1-9ae3-976ee78d7044","Type":"ContainerStarted","Data":"7e4600c7260f2dbb9ac134460325ca62fb3d2edd5ee4a16e554d1d76a238545d"}
Sep 10 15:33:43.209293 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.209269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz"
Sep 10 15:33:43.238731 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.238678    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-pmvkz" podStartSLOduration=1.5587509339999999 podStartE2EDuration="3.238661361s" totalImagesPullingTime="1.679910427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:43.238211978 +0000 UTC m=+100.053287719" watchObservedRunningTime="2026-09-10 15:33:43.238661361 +0000 UTC m=+100.053737101"
Sep 10 15:33:43.239536 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.239491    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s" podStartSLOduration=99.239476405 podStartE2EDuration="1m39.239476405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:43.222836079 +0000 UTC m=+100.037911819" watchObservedRunningTime="2026-09-10 15:33:43.239476405 +0000 UTC m=+100.054552149"
Sep 10 15:33:43.600677 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.600649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:43.681782 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.681740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:43.753565 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:43.753480    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:44.070179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:44.070055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:44.094813 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:44.094783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dx4hr"
Sep 10 15:33:44.153375 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:44.153341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:44.212874 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:44.212832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfrlj" event={"ID":"c6af7b99-dc7d-49b1-9ae3-976ee78d7044","Type":"ContainerStarted","Data":"5a2e85b0768a092f3521450c736d93a3b0cf1d67818cae9316d7e4c2eb4e3cb3"}
Sep 10 15:33:44.337457 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:44.337380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:44.438892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:44.438847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:45.221014 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:45.220954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pvt4" event={"ID":"a2bdf391-fbbf-4277-a0df-48771809d7f2","Type":"ContainerStarted","Data":"e2d06b7233c4cd779735cf511c795518873841ab154520983d3e95eb1881154c"}
Sep 10 15:33:45.221479 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:45.221037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8pvt4" event={"ID":"a2bdf391-fbbf-4277-a0df-48771809d7f2","Type":"ContainerStarted","Data":"af73701e0caf93b0bb34633421bf6bb1648eb8a47607242d25c4b06b615e3719"}
Sep 10 15:33:45.221479 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:45.221213    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:33:45.241532 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:45.241483    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8pvt4" podStartSLOduration=66.164379028 podStartE2EDuration="1m8.241467787s" totalImagesPullingTime="2.077088759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:45.240359352 +0000 UTC m=+102.055435093" watchObservedRunningTime="2026-09-10 15:33:45.241467787 +0000 UTC m=+102.056543527"
Sep 10 15:33:46.226999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:46.226953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gfrlj" event={"ID":"c6af7b99-dc7d-49b1-9ae3-976ee78d7044","Type":"ContainerStarted","Data":"5f62de4b709eb91667e9375e146cfdfd6fce61c42c8b5db2d952e0e3a0d4da4f"}
Sep 10 15:33:46.246441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:46.246389    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gfrlj" podStartSLOduration=34.026995493 podStartE2EDuration="37.246370515s" totalImagesPullingTime="3.219375022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:33:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:46.245714975 +0000 UTC m=+103.060790729" watchObservedRunningTime="2026-09-10 15:33:46.246370515 +0000 UTC m=+103.061446251"
Sep 10 15:33:47.027241 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:47.027211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:47.259850 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:47.259815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:47.367661 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:47.367551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:47.460552 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:47.460519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:47.512554 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:47.512522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:49.236910 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.236877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:49.395845 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.395811    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:49.478988 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.478927    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"]
Sep 10 15:33:49.483584 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.483542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:49.485170 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.485149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.487630 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.487582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ngsnt\""
Sep 10 15:33:49.488461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.488441    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 15:33:49.488533 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.488464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 15:33:49.488593 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.488536    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 15:33:49.491243 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.491218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-65x55"]
Sep 10 15:33:49.494513 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.494495    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"]
Sep 10 15:33:49.494658 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.494637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.496872 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.496856    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 15:33:49.497093 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.497078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 15:33:49.497245 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.497215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nmcbx\""
Sep 10 15:33:49.497407 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.497391    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 15:33:49.497843 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.497823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"]
Sep 10 15:33:49.497917 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.497910    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.501323 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.501302    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 15:33:49.501429 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.501383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qfrd8\""
Sep 10 15:33:49.502175 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.502154    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 15:33:49.502296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.502279    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 15:33:49.509701 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.509682    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"]
Sep 10 15:33:49.594277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.594243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:49.599217 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-textfile\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.599329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-accelerators-collector-config\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8vcm\" (UniqueName: \"kubernetes.io/projected/81466602-fd20-47d7-a1a7-1eb9b20fb127-kube-api-access-g8vcm\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.599441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.599441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd09721a-8841-42aa-b4c2-045c9c476845-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.599441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9dvw\" (UniqueName: \"kubernetes.io/projected/c8971910-ae93-4da1-943f-48b6cd961b27-kube-api-access-s9dvw\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599575 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.599575 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81466602-fd20-47d7-a1a7-1eb9b20fb127-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.599575 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.599688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-root\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-tls\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-sys\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8971910-ae93-4da1-943f-48b6cd961b27-metrics-client-ca\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7csp\" (UniqueName: \"kubernetes.io/projected/fd09721a-8841-42aa-b4c2-045c9c476845-kube-api-access-x7csp\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.599796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.599796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-wtmp\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.599796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.599796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd09721a-8841-42aa-b4c2-045c9c476845-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.693597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.693560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:49.700595 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.700691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-wtmp\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.700691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd09721a-8841-42aa-b4c2-045c9c476845-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.700691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-textfile\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.700691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.700691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-accelerators-collector-config\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.700934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8vcm\" (UniqueName: \"kubernetes.io/projected/81466602-fd20-47d7-a1a7-1eb9b20fb127-kube-api-access-g8vcm\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.700934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.700934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd09721a-8841-42aa-b4c2-045c9c476845-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.700934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-wtmp\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.700934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.700789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9dvw\" (UniqueName: \"kubernetes.io/projected/c8971910-ae93-4da1-943f-48b6cd961b27-kube-api-access-s9dvw\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:49.701027    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-textfile\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:49.701090    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-tls podName:81466602-fd20-47d7-a1a7-1eb9b20fb127 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:50.201071382 +0000 UTC m=+107.016147120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-zv6wp" (UID: "81466602-fd20-47d7-a1a7-1eb9b20fb127") : secret "openshift-state-metrics-tls" not found
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd09721a-8841-42aa-b4c2-045c9c476845-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81466602-fd20-47d7-a1a7-1eb9b20fb127-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:49.701194    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701239 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:49.701245    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-tls podName:fd09721a-8841-42aa-b4c2-045c9c476845 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:50.201231741 +0000 UTC m=+107.016307471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-dqq75" (UID: "fd09721a-8841-42aa-b4c2-045c9c476845") : secret "kube-state-metrics-tls" not found
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-root\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-tls\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-accelerators-collector-config\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-root\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-sys\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8971910-ae93-4da1-943f-48b6cd961b27-sys\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8971910-ae93-4da1-943f-48b6cd961b27-metrics-client-ca\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:49.701499    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7csp\" (UniqueName: \"kubernetes.io/projected/fd09721a-8841-42aa-b4c2-045c9c476845-kube-api-access-x7csp\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.701710 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:33:49.701546    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-tls podName:c8971910-ae93-4da1-943f-48b6cd961b27 nodeName:}" failed. No retries permitted until 2026-09-10 15:33:50.201531597 +0000 UTC m=+107.016607318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-tls") pod "node-exporter-65x55" (UID: "c8971910-ae93-4da1-943f-48b6cd961b27") : secret "node-exporter-tls" not found
Sep 10 15:33:49.702297 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.701862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd09721a-8841-42aa-b4c2-045c9c476845-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.702297 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.702069    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81466602-fd20-47d7-a1a7-1eb9b20fb127-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.702297 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.702122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8971910-ae93-4da1-943f-48b6cd961b27-metrics-client-ca\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.702448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.702310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.703438 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.703413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.703760 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.703739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.703890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.703874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.711520 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.711484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7csp\" (UniqueName: \"kubernetes.io/projected/fd09721a-8841-42aa-b4c2-045c9c476845-kube-api-access-x7csp\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:49.711626 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.711594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8vcm\" (UniqueName: \"kubernetes.io/projected/81466602-fd20-47d7-a1a7-1eb9b20fb127-kube-api-access-g8vcm\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:49.711975 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.711931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9dvw\" (UniqueName: \"kubernetes.io/projected/c8971910-ae93-4da1-943f-48b6cd961b27-kube-api-access-s9dvw\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:49.788106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.788024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:49.889306 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.889270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:49.990276 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:49.990236    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:50.090716 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.090631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:50.190924 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.190893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:50.205414 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.205386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:50.205515 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.205435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:50.205515 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.205475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-tls\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:50.207912 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.207878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8971910-ae93-4da1-943f-48b6cd961b27-node-exporter-tls\") pod \"node-exporter-65x55\" (UID: \"c8971910-ae93-4da1-943f-48b6cd961b27\") " pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:50.208049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.207955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81466602-fd20-47d7-a1a7-1eb9b20fb127-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-zv6wp\" (UID: \"81466602-fd20-47d7-a1a7-1eb9b20fb127\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:50.208109 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.208045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd09721a-8841-42aa-b4c2-045c9c476845-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-dqq75\" (UID: \"fd09721a-8841-42aa-b4c2-045c9c476845\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:50.394355 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.394279    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"
Sep 10 15:33:50.404640 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.404622    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-65x55"
Sep 10 15:33:50.410381 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.410357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"
Sep 10 15:33:50.418187 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:50.418160    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8971910_ae93_4da1_943f_48b6cd961b27.slice/crio-bb87817550dd47f41d926670e7290d6058adc9bad070b6fa03ce639ce4c0835a WatchSource:0}: Error finding container bb87817550dd47f41d926670e7290d6058adc9bad070b6fa03ce639ce4c0835a: Status 404 returned error can't find the container with id bb87817550dd47f41d926670e7290d6058adc9bad070b6fa03ce639ce4c0835a
Sep 10 15:33:50.489317 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.489200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:50.569001 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.568948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:50.576163 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.576133    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:33:50.581470 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.581452    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.586706 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.586686    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 15:33:50.587096 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587072    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 15:33:50.587240 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587219    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 15:33:50.587498 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587480    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 15:33:50.587574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587533    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5zkzz\""
Sep 10 15:33:50.587638 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 15:33:50.587638 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587617    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 15:33:50.587924 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587737    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 15:33:50.587924 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587822    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 15:33:50.587924 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.587890    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 15:33:50.596424 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.596403    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:33:50.674902 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.674877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp"]
Sep 10 15:33:50.678368 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:50.678345    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81466602_fd20_47d7_a1a7_1eb9b20fb127.slice/crio-83d5fa470581932abb7b4b50801876f05f43601914bcbefcbc6c1b2b1c6556be WatchSource:0}: Error finding container 83d5fa470581932abb7b4b50801876f05f43601914bcbefcbc6c1b2b1c6556be: Status 404 returned error can't find the container with id 83d5fa470581932abb7b4b50801876f05f43601914bcbefcbc6c1b2b1c6556be
Sep 10 15:33:50.698227 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.698205    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-dqq75"]
Sep 10 15:33:50.708019 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:50.707995    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd09721a_8841_42aa_b4c2_045c9c476845.slice/crio-5cd24f7d0415e33fba5a57e7a6c080e3a419cd2588ea6e7d0d3272ae0a29125d WatchSource:0}: Error finding container 5cd24f7d0415e33fba5a57e7a6c080e3a419cd2588ea6e7d0d3272ae0a29125d: Status 404 returned error can't find the container with id 5cd24f7d0415e33fba5a57e7a6c080e3a419cd2588ea6e7d0d3272ae0a29125d
Sep 10 15:33:50.709846 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.709826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710077 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.709869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzwrl\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-kube-api-access-nzwrl\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710077 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.709907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710077 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.709945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710077 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-config-out\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710077 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-config-volume\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-web-config\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.710313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.710297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811198 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-web-config\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811302 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811302 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811302 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzwrl\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-kube-api-access-nzwrl\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-config-out\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811681 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811681 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811779 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-config-volume\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811779 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811888 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.811888 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.811811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.812030 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.812008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.812654 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.812624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.814220 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.814191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.814648 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.814400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-config-out\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.814648 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.814417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.815369 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.815345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.816261 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.816199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.816361 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.816272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.816361 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.816327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.817484 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.817455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-web-config\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.817601 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.817571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.817664 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.817620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-config-volume\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.821493 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.821423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzwrl\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-kube-api-access-nzwrl\") pod \"alertmanager-main-0\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.891500 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.891464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:33:50.909550 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:50.909514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:51.000614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:51.000566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:51.180073 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:51.180045    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:33:51.180559 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:51.180539    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e67d1b_497d_41f7_917e_112c5279c49d.slice/crio-e569b9d30c0b9a9d985de3efb7fcc2686a624ef292842104266df8fda83a0bf6 WatchSource:0}: Error finding container e569b9d30c0b9a9d985de3efb7fcc2686a624ef292842104266df8fda83a0bf6: Status 404 returned error can't find the container with id e569b9d30c0b9a9d985de3efb7fcc2686a624ef292842104266df8fda83a0bf6
Sep 10 15:33:51.249441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:51.249333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerStarted","Data":"e569b9d30c0b9a9d985de3efb7fcc2686a624ef292842104266df8fda83a0bf6"}
Sep 10 15:33:51.250924 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:51.250876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-65x55" event={"ID":"c8971910-ae93-4da1-943f-48b6cd961b27","Type":"ContainerStarted","Data":"bb87817550dd47f41d926670e7290d6058adc9bad070b6fa03ce639ce4c0835a"}
Sep 10 15:33:51.252166 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:51.252130    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75" event={"ID":"fd09721a-8841-42aa-b4c2-045c9c476845","Type":"ContainerStarted","Data":"5cd24f7d0415e33fba5a57e7a6c080e3a419cd2588ea6e7d0d3272ae0a29125d"}
Sep 10 15:33:51.254333 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:51.254305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp" event={"ID":"81466602-fd20-47d7-a1a7-1eb9b20fb127","Type":"ContainerStarted","Data":"5781d4fb23c1fe202d13d7ad82db43cc1b743dbf4b05fbfdef7f4576fd03faed"}
Sep 10 15:33:51.254446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:51.254356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp" event={"ID":"81466602-fd20-47d7-a1a7-1eb9b20fb127","Type":"ContainerStarted","Data":"2ae9167bacad50922d4e448c10924ac851c8bd9ce94bc0c16f10c445527f1f25"}
Sep 10 15:33:51.254446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:51.254375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp" event={"ID":"81466602-fd20-47d7-a1a7-1eb9b20fb127","Type":"ContainerStarted","Data":"83d5fa470581932abb7b4b50801876f05f43601914bcbefcbc6c1b2b1c6556be"}
Sep 10 15:33:52.261375 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.261337    2565 generic.go:356] "Generic (PLEG): container finished" podID="c8971910-ae93-4da1-943f-48b6cd961b27" containerID="4075c2a45c1c49369278e2f6fa67fb327d1628b767b66e672cea16b94963cf5a" exitCode=0
Sep 10 15:33:52.261816 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.261420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-65x55" event={"ID":"c8971910-ae93-4da1-943f-48b6cd961b27","Type":"ContainerDied","Data":"4075c2a45c1c49369278e2f6fa67fb327d1628b767b66e672cea16b94963cf5a"}
Sep 10 15:33:52.435548 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.435521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:52.539140 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.539059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:52.545650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.545617    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77495578cc-zzk6h"]
Sep 10 15:33:52.550823 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.550115    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.554361 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.554336    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 15:33:52.556099 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.554616    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5j1m54bkqrugr\""
Sep 10 15:33:52.556099 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.554834    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 15:33:52.556099 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.555064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 15:33:52.556099 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.555393    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p7p5k\""
Sep 10 15:33:52.556099 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.555659    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 15:33:52.556099 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.555903    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 15:33:52.568783 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.568751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77495578cc-zzk6h"]
Sep 10 15:33:52.637257 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.637178    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:52.734017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.733981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-grpc-tls\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.734158 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.734084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/090b63fa-ba58-40af-b3d0-596d98349b0e-metrics-client-ca\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.734158 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.734115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.734287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.734182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.734287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.734231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-tls\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.734390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.734304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.734390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.734349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.734479 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.734411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7bkl\" (UniqueName: \"kubernetes.io/projected/090b63fa-ba58-40af-b3d0-596d98349b0e-kube-api-access-q7bkl\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.736669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.736642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:52.835990 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.835901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.835990 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.835977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.836228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.836006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7bkl\" (UniqueName: \"kubernetes.io/projected/090b63fa-ba58-40af-b3d0-596d98349b0e-kube-api-access-q7bkl\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.836228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.836052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-grpc-tls\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.836228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.836110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/090b63fa-ba58-40af-b3d0-596d98349b0e-metrics-client-ca\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.836228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.836139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.836228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.836184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.836228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.836221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-tls\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.837109 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.837054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/090b63fa-ba58-40af-b3d0-596d98349b0e-metrics-client-ca\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.839647 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.839585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-tls\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.839756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.839656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.839944 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.839923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-grpc-tls\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.841191 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.841164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.841319 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.841229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.841715 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.841694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/090b63fa-ba58-40af-b3d0-596d98349b0e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.844603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.844580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7bkl\" (UniqueName: \"kubernetes.io/projected/090b63fa-ba58-40af-b3d0-596d98349b0e-kube-api-access-q7bkl\") pod \"thanos-querier-77495578cc-zzk6h\" (UID: \"090b63fa-ba58-40af-b3d0-596d98349b0e\") " pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:52.869849 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:52.869796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:53.260954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.260883    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77495578cc-zzk6h"]
Sep 10 15:33:53.263766 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:53.263736    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090b63fa_ba58_40af_b3d0_596d98349b0e.slice/crio-8f75e4a01c0eee1c9c87519126e4851d934e30002a06514a52caae26cba8af98 WatchSource:0}: Error finding container 8f75e4a01c0eee1c9c87519126e4851d934e30002a06514a52caae26cba8af98: Status 404 returned error can't find the container with id 8f75e4a01c0eee1c9c87519126e4851d934e30002a06514a52caae26cba8af98
Sep 10 15:33:53.267308 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.267285    2565 generic.go:356] "Generic (PLEG): container finished" podID="61e67d1b-497d-41f7-917e-112c5279c49d" containerID="f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8" exitCode=0
Sep 10 15:33:53.267435 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.267402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerDied","Data":"f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8"}
Sep 10 15:33:53.269882 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.269860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-65x55" event={"ID":"c8971910-ae93-4da1-943f-48b6cd961b27","Type":"ContainerStarted","Data":"3449ec108b69e6f789146f697a01a07d452463ebc9fbab706a01b83e0af07c91"}
Sep 10 15:33:53.269993 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.269902    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-65x55" event={"ID":"c8971910-ae93-4da1-943f-48b6cd961b27","Type":"ContainerStarted","Data":"1054e9105eefd4576cc9fb25bacfb99b562cdca83691095490e40edaf57d18a4"}
Sep 10 15:33:53.272213 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.272187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75" event={"ID":"fd09721a-8841-42aa-b4c2-045c9c476845","Type":"ContainerStarted","Data":"e4270acc0fd1ecf3bb3806740cef30257cf337424861477ed6f5b79ccf822808"}
Sep 10 15:33:53.272327 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.272233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75" event={"ID":"fd09721a-8841-42aa-b4c2-045c9c476845","Type":"ContainerStarted","Data":"c72244d05eb2fa3323d0e982fb8e2d7cd68f087b8e97255f7d31cf3e0429ee55"}
Sep 10 15:33:53.272327 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.272262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75" event={"ID":"fd09721a-8841-42aa-b4c2-045c9c476845","Type":"ContainerStarted","Data":"8fada40fbc707e7624c8a3bfd3cd283fef6f92e294528d9267eb2064c0a38af1"}
Sep 10 15:33:53.274208 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.274189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp" event={"ID":"81466602-fd20-47d7-a1a7-1eb9b20fb127","Type":"ContainerStarted","Data":"d5d006dd5b052fce934103f9145ef27e027c900c9a3ec53aeeebe313859f1511"}
Sep 10 15:33:53.311086 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.311042    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zv6wp" podStartSLOduration=2.718571507 podStartE2EDuration="4.311028671s" totalImagesPullingTime="1.592457164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:53.309927635 +0000 UTC m=+110.125003431" watchObservedRunningTime="2026-09-10 15:33:53.311028671 +0000 UTC m=+110.126104410"
Sep 10 15:33:53.330631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.330557    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-65x55" podStartSLOduration=3.016435728 podStartE2EDuration="4.330540994s" totalImagesPullingTime="1.239738066s" totalInitContainerRuntime="74.3672ms" isStatefulPod=true podCreationTimestamp="2026-09-10 15:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:53.330215484 +0000 UTC m=+110.145291225" watchObservedRunningTime="2026-09-10 15:33:53.330540994 +0000 UTC m=+110.145616751"
Sep 10 15:33:53.350632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.350584    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dqq75" podStartSLOduration=2.637628238 podStartE2EDuration="4.350570805s" totalImagesPullingTime="1.712942567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:53.349334605 +0000 UTC m=+110.164410344" watchObservedRunningTime="2026-09-10 15:33:53.350570805 +0000 UTC m=+110.165646545"
Sep 10 15:33:53.813715 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.813687    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54fcb87db5-xcnpg"]
Sep 10 15:33:53.818007 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.817983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.822737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.822712    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 15:33:53.824128 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.823685    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 15:33:53.824128 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.823700    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7dmm6\""
Sep 10 15:33:53.824128 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.823766    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 15:33:53.824128 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.823802    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-alnk97420n7mh\""
Sep 10 15:33:53.824128 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.823991    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 15:33:53.829759 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.829735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54fcb87db5-xcnpg"]
Sep 10 15:33:53.844940 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.844915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b93561f7-963b-4266-9e6f-0acbd0250f0f-audit-log\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.845101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.844952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx86j\" (UniqueName: \"kubernetes.io/projected/b93561f7-963b-4266-9e6f-0acbd0250f0f-kube-api-access-rx86j\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.845101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.845006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b93561f7-963b-4266-9e6f-0acbd0250f0f-metrics-server-audit-profiles\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.845101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.845030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-client-ca-bundle\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.845101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.845067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-secret-metrics-server-client-certs\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.845298 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.845124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b93561f7-963b-4266-9e6f-0acbd0250f0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.845298 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.845227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-secret-metrics-server-tls\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.946169 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.946129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b93561f7-963b-4266-9e6f-0acbd0250f0f-audit-log\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.946333 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.946180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx86j\" (UniqueName: \"kubernetes.io/projected/b93561f7-963b-4266-9e6f-0acbd0250f0f-kube-api-access-rx86j\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.946333 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.946213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b93561f7-963b-4266-9e6f-0acbd0250f0f-metrics-server-audit-profiles\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.946333 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.946237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-client-ca-bundle\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.946333 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.946272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-secret-metrics-server-client-certs\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.946566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.946332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b93561f7-963b-4266-9e6f-0acbd0250f0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.946566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.946435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-secret-metrics-server-tls\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.946566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.946509    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b93561f7-963b-4266-9e6f-0acbd0250f0f-audit-log\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.947393 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.947361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b93561f7-963b-4266-9e6f-0acbd0250f0f-metrics-server-audit-profiles\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.947483 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.947445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b93561f7-963b-4266-9e6f-0acbd0250f0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.949199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.949171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-secret-metrics-server-client-certs\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.949489 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.949468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-client-ca-bundle\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.949719 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.949700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b93561f7-963b-4266-9e6f-0acbd0250f0f-secret-metrics-server-tls\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:53.954807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:53.954782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx86j\" (UniqueName: \"kubernetes.io/projected/b93561f7-963b-4266-9e6f-0acbd0250f0f-kube-api-access-rx86j\") pod \"metrics-server-54fcb87db5-xcnpg\" (UID: \"b93561f7-963b-4266-9e6f-0acbd0250f0f\") " pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:54.133636 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:54.133558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:33:54.257107 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:54.257065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:54.281369 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:54.281159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h" event={"ID":"090b63fa-ba58-40af-b3d0-596d98349b0e","Type":"ContainerStarted","Data":"8f75e4a01c0eee1c9c87519126e4851d934e30002a06514a52caae26cba8af98"}
Sep 10 15:33:54.331304 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:54.331274    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:54.420612 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:54.420578    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54fcb87db5-xcnpg"]
Sep 10 15:33:54.424002 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:33:54.423943    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93561f7_963b_4266_9e6f_0acbd0250f0f.slice/crio-f041561b656a0fa32fe6d0f75a273bf11dec4a64c9046a001d3d75eeffa13588 WatchSource:0}: Error finding container f041561b656a0fa32fe6d0f75a273bf11dec4a64c9046a001d3d75eeffa13588: Status 404 returned error can't find the container with id f041561b656a0fa32fe6d0f75a273bf11dec4a64c9046a001d3d75eeffa13588
Sep 10 15:33:54.478482 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:54.478402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:54.932400 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:54.932370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:55.033494 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:55.033464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:55.229628 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:55.229553    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8pvt4"
Sep 10 15:33:55.289585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:55.289548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerStarted","Data":"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65"}
Sep 10 15:33:55.289999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:55.289634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerStarted","Data":"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d"}
Sep 10 15:33:55.291702 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:55.291645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg" event={"ID":"b93561f7-963b-4266-9e6f-0acbd0250f0f","Type":"ContainerStarted","Data":"f041561b656a0fa32fe6d0f75a273bf11dec4a64c9046a001d3d75eeffa13588"}
Sep 10 15:33:55.355778 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:55.355735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:55.460488 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:55.460452    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:55.773271 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:55.773243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:56.302114 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:56.302074    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h" event={"ID":"090b63fa-ba58-40af-b3d0-596d98349b0e","Type":"ContainerStarted","Data":"bb080e289bb8b15300dc426a582566079bfca026f100848f1abb309959329195"}
Sep 10 15:33:56.309260 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:56.309092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerStarted","Data":"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f"}
Sep 10 15:33:56.309260 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:56.309177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerStarted","Data":"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0"}
Sep 10 15:33:56.310909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:56.310887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg" event={"ID":"b93561f7-963b-4266-9e6f-0acbd0250f0f","Type":"ContainerStarted","Data":"a167d90203034858d7273f77ebec05e50df4a70a2cfa9bbeb31ed64465d3082d"}
Sep 10 15:33:56.333985 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:56.332727    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg" podStartSLOduration=1.566635979 podStartE2EDuration="3.332714006s" totalImagesPullingTime="1.766078027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:56.332304457 +0000 UTC m=+113.147380199" watchObservedRunningTime="2026-09-10 15:33:56.332714006 +0000 UTC m=+113.147789738"
Sep 10 15:33:56.336749 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:56.336721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:56.396631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:56.396551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:33:57.317542 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:57.317514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h" event={"ID":"090b63fa-ba58-40af-b3d0-596d98349b0e","Type":"ContainerStarted","Data":"391117601bbb5b64f380a2da9601ec121dfe7620b26cf55f94f7ed1da56b5073"}
Sep 10 15:33:57.317896 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:57.317628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h" event={"ID":"090b63fa-ba58-40af-b3d0-596d98349b0e","Type":"ContainerStarted","Data":"70493f573f2192ed48e117429d76745884883841693a376d25e63e129be12e1c"}
Sep 10 15:33:57.324287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:57.324265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerStarted","Data":"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f"}
Sep 10 15:33:58.331608 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:58.331570    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h" event={"ID":"090b63fa-ba58-40af-b3d0-596d98349b0e","Type":"ContainerStarted","Data":"0852fc2738de959226162dbc5b8865fa598abbeda96330b91b6d76fd5e9bf697"}
Sep 10 15:33:58.332089 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:58.331658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h" event={"ID":"090b63fa-ba58-40af-b3d0-596d98349b0e","Type":"ContainerStarted","Data":"8bcfa4786245143ab46216b42026a0166c0854b2a633a810663c81a50e07510f"}
Sep 10 15:33:58.332089 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:58.331711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:33:58.332089 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:58.331755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h" event={"ID":"090b63fa-ba58-40af-b3d0-596d98349b0e","Type":"ContainerStarted","Data":"9015dc1522628c0cf66069442459351aca0714eb3164ed64edd57f1499582676"}
Sep 10 15:33:58.334748 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:58.334727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerStarted","Data":"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e"}
Sep 10 15:33:58.362666 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:58.362626    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h" podStartSLOduration=2.541479712 podStartE2EDuration="6.362612877s" totalImagesPullingTime="3.821133165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:58.361606824 +0000 UTC m=+115.176682585" watchObservedRunningTime="2026-09-10 15:33:58.362612877 +0000 UTC m=+115.177688630"
Sep 10 15:33:58.393073 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:33:58.393028    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.858571596 podStartE2EDuration="8.393012912s" totalImagesPullingTime="4.519334341s" totalInitContainerRuntime="15.106975ms" isStatefulPod=false podCreationTimestamp="2026-09-10 15:33:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:33:58.391790135 +0000 UTC m=+115.206865913" watchObservedRunningTime="2026-09-10 15:33:58.393012912 +0000 UTC m=+115.208088653"
Sep 10 15:34:00.189808 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.189773    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-597c5d4c87-6nvkq"]
Sep 10 15:34:00.195748 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.195728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.198576 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.198556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 15:34:00.199388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.199361    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 15:34:00.199510 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.199439    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 15:34:00.199510 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.199462    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 15:34:00.199510 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.199493    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 15:34:00.199660 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.199492    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jdlj5\""
Sep 10 15:34:00.199660 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.199553    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 15:34:00.200061 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.200041    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 15:34:00.204506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.204477    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 15:34:00.205921 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.205902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-597c5d4c87-6nvkq"]
Sep 10 15:34:00.304173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.304144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-oauth-serving-cert\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.304335 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.304181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-trusted-ca-bundle\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.304335 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.304205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x855\" (UniqueName: \"kubernetes.io/projected/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-kube-api-access-8x855\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.304335 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.304254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-config\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.304335 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.304334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-oauth-config\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.304499 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.304355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-service-ca\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.304499 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.304400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-serving-cert\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405095 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-oauth-serving-cert\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405095 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-trusted-ca-bundle\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405300 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x855\" (UniqueName: \"kubernetes.io/projected/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-kube-api-access-8x855\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405300 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-config\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405300 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-oauth-config\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405300 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-service-ca\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405300 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-serving-cert\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405858 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405828    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-oauth-serving-cert\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.405996 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.405921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-config\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.406070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.406026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-service-ca\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.406070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.406033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-trusted-ca-bundle\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.407681 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.407662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-oauth-config\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.407764 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.407755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-serving-cert\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.413039 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.413009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x855\" (UniqueName: \"kubernetes.io/projected/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-kube-api-access-8x855\") pod \"console-597c5d4c87-6nvkq\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") " pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.506369 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.506289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:00.779676 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.779653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-597c5d4c87-6nvkq"]
Sep 10 15:34:00.781621 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:34:00.781596    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f110e2b_f9d1_40ee_be56_1a96cd99a43b.slice/crio-10cd585d1bab03ad5c7fdf583d535d7944df3f524845d8a7d7acbe59ae18e943 WatchSource:0}: Error finding container 10cd585d1bab03ad5c7fdf583d535d7944df3f524845d8a7d7acbe59ae18e943: Status 404 returned error can't find the container with id 10cd585d1bab03ad5c7fdf583d535d7944df3f524845d8a7d7acbe59ae18e943
Sep 10 15:34:00.955878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:00.955843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:01.055614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.055525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:01.350183 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.350105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597c5d4c87-6nvkq" event={"ID":"9f110e2b-f9d1-40ee-be56-1a96cd99a43b","Type":"ContainerStarted","Data":"10cd585d1bab03ad5c7fdf583d535d7944df3f524845d8a7d7acbe59ae18e943"}
Sep 10 15:34:01.527689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.527652    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c696c4f5b-drx9s"]
Sep 10 15:34:01.532577 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.532551    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:34:01.613113 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.613005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:01.687649 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.687611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:01.758334 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.758285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:01.859271 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.859243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:01.961643 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.961614    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-597c5d4c87-6nvkq"]
Sep 10 15:34:01.962005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:01.961978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:04.346873 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:04.346843    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77495578cc-zzk6h"
Sep 10 15:34:04.366218 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:04.366185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597c5d4c87-6nvkq" event={"ID":"9f110e2b-f9d1-40ee-be56-1a96cd99a43b","Type":"ContainerStarted","Data":"899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970"}
Sep 10 15:34:04.394188 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:04.394137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-597c5d4c87-6nvkq" podStartSLOduration=1.6575419729999998 podStartE2EDuration="4.394114504s" totalImagesPullingTime="2.736572531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:34:04.392876569 +0000 UTC m=+121.207952311" watchObservedRunningTime="2026-09-10 15:34:04.394114504 +0000 UTC m=+121.209190254"
Sep 10 15:34:07.360151 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:07.360106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:07.420116 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:07.420078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:09.119368 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:09.119325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:09.180778 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:09.180747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:10.506727 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:10.506688    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:12.558532 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:12.558494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:12.614293 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:12.614264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:12.670261 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:12.670207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:13.521897 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:13.521863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:34:13.524173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:13.524154    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b48c88a3-d212-47b7-bb49-118f3d58fb3d-metrics-certs\") pod \"network-metrics-daemon-5qpdw\" (UID: \"b48c88a3-d212-47b7-bb49-118f3d58fb3d\") " pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:34:13.649051 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:13.649017    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gcptc\""
Sep 10 15:34:13.656874 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:13.656853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qpdw"
Sep 10 15:34:13.928059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:13.928028    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5qpdw"]
Sep 10 15:34:13.930497 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:34:13.930469    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48c88a3_d212_47b7_bb49_118f3d58fb3d.slice/crio-0a0833299659bfa57d2a3fd5807fa52fbfad552ef136b0b4d682c82b09199c44 WatchSource:0}: Error finding container 0a0833299659bfa57d2a3fd5807fa52fbfad552ef136b0b4d682c82b09199c44: Status 404 returned error can't find the container with id 0a0833299659bfa57d2a3fd5807fa52fbfad552ef136b0b4d682c82b09199c44
Sep 10 15:34:14.134053 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:14.134023    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:34:14.134216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:14.134089    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:34:14.406585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:14.406547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qpdw" event={"ID":"b48c88a3-d212-47b7-bb49-118f3d58fb3d","Type":"ContainerStarted","Data":"0a0833299659bfa57d2a3fd5807fa52fbfad552ef136b0b4d682c82b09199c44"}
Sep 10 15:34:15.413260 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:15.413218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qpdw" event={"ID":"b48c88a3-d212-47b7-bb49-118f3d58fb3d","Type":"ContainerStarted","Data":"cdde93eb7c4c1849187159f79579996f023ab6ff4e7853af21c1d28482cb813d"}
Sep 10 15:34:15.413666 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:15.413308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qpdw" event={"ID":"b48c88a3-d212-47b7-bb49-118f3d58fb3d","Type":"ContainerStarted","Data":"500c8b39a89b3bfb99a98b968ee2d35bb39d6ca9dc3c92823f662cd085c7c267"}
Sep 10 15:34:15.428543 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:15.428482    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5qpdw" podStartSLOduration=130.212597935 podStartE2EDuration="2m11.428451203s" totalImagesPullingTime="1.215853268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:34:15.428395994 +0000 UTC m=+132.243471738" watchObservedRunningTime="2026-09-10 15:34:15.428451203 +0000 UTC m=+132.243526969"
Sep 10 15:34:15.519459 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:15.519400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:15.573702 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:15.573661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:17.601134 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:17.601094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:17.673302 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:17.673265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:24.450378 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:24.450346    2565 generic.go:356] "Generic (PLEG): container finished" podID="a01fa180-3e1e-4f71-a28b-4af0c406be76" containerID="a84b6ed2e50f455db7c8a7fc23c69339effd2bb323e7f43f179e91003776cb40" exitCode=0
Sep 10 15:34:24.450871 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:24.450425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt" event={"ID":"a01fa180-3e1e-4f71-a28b-4af0c406be76","Type":"ContainerDied","Data":"a84b6ed2e50f455db7c8a7fc23c69339effd2bb323e7f43f179e91003776cb40"}
Sep 10 15:34:24.450871 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:24.450748    2565 scope.go:117] "RemoveContainer" containerID="a84b6ed2e50f455db7c8a7fc23c69339effd2bb323e7f43f179e91003776cb40"
Sep 10 15:34:25.456381 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:25.456349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-v92gt" event={"ID":"a01fa180-3e1e-4f71-a28b-4af0c406be76","Type":"ContainerStarted","Data":"df1e33abfb006971aafec4c12690659fc31069bfbfafe795f39eb77ee87c03f9"}
Sep 10 15:34:26.551019 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.550938    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s" podUID="0b995ff5-f42a-4fa3-8e00-d2f90a02decf" containerName="registry" containerID="cri-o://5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e" gracePeriod=30
Sep 10 15:34:26.796270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.796241    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:34:26.947774 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.947723    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-ca-trust-extracted\") pod \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") "
Sep 10 15:34:26.947955 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.947844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-trusted-ca\") pod \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") "
Sep 10 15:34:26.947955 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.947863    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cnw9\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-kube-api-access-9cnw9\") pod \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") "
Sep 10 15:34:26.947955 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.947885    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-certificates\") pod \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") "
Sep 10 15:34:26.947955 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.947923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") pod \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") "
Sep 10 15:34:26.948233 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.948126    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-bound-sa-token\") pod \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") "
Sep 10 15:34:26.948233 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.948180    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-installation-pull-secrets\") pod \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") "
Sep 10 15:34:26.948233 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.948208    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-image-registry-private-configuration\") pod \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\" (UID: \"0b995ff5-f42a-4fa3-8e00-d2f90a02decf\") "
Sep 10 15:34:26.948379 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.948333    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0b995ff5-f42a-4fa3-8e00-d2f90a02decf" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:34:26.948433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.948408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0b995ff5-f42a-4fa3-8e00-d2f90a02decf" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:34:26.949221 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.948612    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-certificates\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:26.949221 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.948637    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-trusted-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:26.950714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.950685    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0b995ff5-f42a-4fa3-8e00-d2f90a02decf" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:34:26.950819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.950717    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0b995ff5-f42a-4fa3-8e00-d2f90a02decf" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:34:26.950819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.950770    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0b995ff5-f42a-4fa3-8e00-d2f90a02decf" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:34:26.950911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.950864    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-kube-api-access-9cnw9" (OuterVolumeSpecName: "kube-api-access-9cnw9") pod "0b995ff5-f42a-4fa3-8e00-d2f90a02decf" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf"). InnerVolumeSpecName "kube-api-access-9cnw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:34:26.950946 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.950904    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0b995ff5-f42a-4fa3-8e00-d2f90a02decf" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:34:26.956737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:26.956712    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0b995ff5-f42a-4fa3-8e00-d2f90a02decf" (UID: "0b995ff5-f42a-4fa3-8e00-d2f90a02decf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:34:27.049598 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.049545    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-registry-tls\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:27.049598 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.049594    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-bound-sa-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:27.049598 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.049607    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-installation-pull-secrets\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:27.049809 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.049626    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-image-registry-private-configuration\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:27.049809 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.049639    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-ca-trust-extracted\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:27.049809 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.049650    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cnw9\" (UniqueName: \"kubernetes.io/projected/0b995ff5-f42a-4fa3-8e00-d2f90a02decf-kube-api-access-9cnw9\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:27.465459 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.465426    2565 generic.go:356] "Generic (PLEG): container finished" podID="0b995ff5-f42a-4fa3-8e00-d2f90a02decf" containerID="5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e" exitCode=0
Sep 10 15:34:27.465652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.465470    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s"
Sep 10 15:34:27.465652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.465514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s" event={"ID":"0b995ff5-f42a-4fa3-8e00-d2f90a02decf","Type":"ContainerDied","Data":"5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e"}
Sep 10 15:34:27.465652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.465571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c696c4f5b-drx9s" event={"ID":"0b995ff5-f42a-4fa3-8e00-d2f90a02decf","Type":"ContainerDied","Data":"2cc86d0716f7edad97cdf70642f85d5ea5a3d32f9a5b34371d3421c78dc86b7d"}
Sep 10 15:34:27.465652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.465597    2565 scope.go:117] "RemoveContainer" containerID="5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e"
Sep 10 15:34:27.476126 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.476106    2565 scope.go:117] "RemoveContainer" containerID="5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e"
Sep 10 15:34:27.476428 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:34:27.476410    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e\": container with ID starting with 5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e not found: ID does not exist" containerID="5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e"
Sep 10 15:34:27.476498 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.476439    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e"} err="failed to get container status \"5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e\": rpc error: code = NotFound desc = could not find container \"5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e\": container with ID starting with 5c92f56a79fc301b53f95e60ab4a496a9933c47776521b778a2a056bb577ee9e not found: ID does not exist"
Sep 10 15:34:27.489892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.489865    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c696c4f5b-drx9s"]
Sep 10 15:34:27.493728 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.493705    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c696c4f5b-drx9s"]
Sep 10 15:34:27.823467 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:27.823388    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b995ff5-f42a-4fa3-8e00-d2f90a02decf" path="/var/lib/kubelet/pods/0b995ff5-f42a-4fa3-8e00-d2f90a02decf/volumes"
Sep 10 15:34:29.386089 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.386032    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-597c5d4c87-6nvkq" podUID="9f110e2b-f9d1-40ee-be56-1a96cd99a43b" containerName="console" containerID="cri-o://899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970" gracePeriod=15
Sep 10 15:34:29.638782 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.638713    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:29.771825 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.771785    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-trusted-ca-bundle\") pod \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") "
Sep 10 15:34:29.772034 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.771833    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-service-ca\") pod \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") "
Sep 10 15:34:29.772034 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.771852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-serving-cert\") pod \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") "
Sep 10 15:34:29.772156 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772031    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-oauth-config\") pod \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") "
Sep 10 15:34:29.772156 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772101    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x855\" (UniqueName: \"kubernetes.io/projected/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-kube-api-access-8x855\") pod \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") "
Sep 10 15:34:29.772156 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772140    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-config\") pod \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") "
Sep 10 15:34:29.772307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772203    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-oauth-serving-cert\") pod \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\" (UID: \"9f110e2b-f9d1-40ee-be56-1a96cd99a43b\") "
Sep 10 15:34:29.772307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772263    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-service-ca" (OuterVolumeSpecName: "service-ca") pod "9f110e2b-f9d1-40ee-be56-1a96cd99a43b" (UID: "9f110e2b-f9d1-40ee-be56-1a96cd99a43b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:34:29.772307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9f110e2b-f9d1-40ee-be56-1a96cd99a43b" (UID: "9f110e2b-f9d1-40ee-be56-1a96cd99a43b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:34:29.772555 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772534    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-trusted-ca-bundle\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:29.772555 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772545    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9f110e2b-f9d1-40ee-be56-1a96cd99a43b" (UID: "9f110e2b-f9d1-40ee-be56-1a96cd99a43b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:34:29.772673 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772563    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:29.772673 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.772563    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-config" (OuterVolumeSpecName: "console-config") pod "9f110e2b-f9d1-40ee-be56-1a96cd99a43b" (UID: "9f110e2b-f9d1-40ee-be56-1a96cd99a43b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:34:29.774337 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.774303    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9f110e2b-f9d1-40ee-be56-1a96cd99a43b" (UID: "9f110e2b-f9d1-40ee-be56-1a96cd99a43b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:34:29.774337 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.774333    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9f110e2b-f9d1-40ee-be56-1a96cd99a43b" (UID: "9f110e2b-f9d1-40ee-be56-1a96cd99a43b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:34:29.774483 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.774409    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-kube-api-access-8x855" (OuterVolumeSpecName: "kube-api-access-8x855") pod "9f110e2b-f9d1-40ee-be56-1a96cd99a43b" (UID: "9f110e2b-f9d1-40ee-be56-1a96cd99a43b"). InnerVolumeSpecName "kube-api-access-8x855". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:34:29.873707 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.873673    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-serving-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:29.873707 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.873705    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-oauth-config\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:29.873707 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.873715    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x855\" (UniqueName: \"kubernetes.io/projected/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-kube-api-access-8x855\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:29.873925 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.873724    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-console-config\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:29.873925 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:29.873732    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f110e2b-f9d1-40ee-be56-1a96cd99a43b-oauth-serving-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:34:30.479545 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.479507    2565 generic.go:356] "Generic (PLEG): container finished" podID="9f110e2b-f9d1-40ee-be56-1a96cd99a43b" containerID="899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970" exitCode=0
Sep 10 15:34:30.480072 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.479549    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597c5d4c87-6nvkq"
Sep 10 15:34:30.480072 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.479589    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597c5d4c87-6nvkq" event={"ID":"9f110e2b-f9d1-40ee-be56-1a96cd99a43b","Type":"ContainerDied","Data":"899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970"}
Sep 10 15:34:30.480072 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.479636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597c5d4c87-6nvkq" event={"ID":"9f110e2b-f9d1-40ee-be56-1a96cd99a43b","Type":"ContainerDied","Data":"10cd585d1bab03ad5c7fdf583d535d7944df3f524845d8a7d7acbe59ae18e943"}
Sep 10 15:34:30.480072 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.479657    2565 scope.go:117] "RemoveContainer" containerID="899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970"
Sep 10 15:34:30.487948 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.487921    2565 scope.go:117] "RemoveContainer" containerID="899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970"
Sep 10 15:34:30.488273 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:34:30.488251    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970\": container with ID starting with 899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970 not found: ID does not exist" containerID="899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970"
Sep 10 15:34:30.488338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.488282    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970"} err="failed to get container status \"899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970\": rpc error: code = NotFound desc = could not find container \"899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970\": container with ID starting with 899354e70d78b6947b73494d9f48e427919a947b53ba18b8d7fc4b865199b970 not found: ID does not exist"
Sep 10 15:34:30.495999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.495952    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-597c5d4c87-6nvkq"]
Sep 10 15:34:30.501593 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:30.501564    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-597c5d4c87-6nvkq"]
Sep 10 15:34:31.104508 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:31.104466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:31.822622 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:31.822584    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f110e2b-f9d1-40ee-be56-1a96cd99a43b" path="/var/lib/kubelet/pods/9f110e2b-f9d1-40ee-be56-1a96cd99a43b/volumes"
Sep 10 15:34:32.592662 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:32.592628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:32.654427 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:32.654387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:34.139464 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:34.139434    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:34:34.143197 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:34.143168    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54fcb87db5-xcnpg"
Sep 10 15:34:39.518096 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:39.518058    2565 generic.go:356] "Generic (PLEG): container finished" podID="6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2" containerID="9f35c122341b559f69fcdb2a24cc356280c6ee9b154876db0eef014429079193" exitCode=0
Sep 10 15:34:39.518566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:39.518132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb" event={"ID":"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2","Type":"ContainerDied","Data":"9f35c122341b559f69fcdb2a24cc356280c6ee9b154876db0eef014429079193"}
Sep 10 15:34:39.518630 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:39.518595    2565 scope.go:117] "RemoveContainer" containerID="9f35c122341b559f69fcdb2a24cc356280c6ee9b154876db0eef014429079193"
Sep 10 15:34:40.337997 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:40.337950    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8646695894-4pgll_6ee431f4-2197-4401-94bb-3810063e3595/router/0.log"
Sep 10 15:34:40.344311 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:40.344279    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7kl4j_c1e17b5c-42fa-4eec-b61a-2eb94a534625/serve-healthcheck-canary/0.log"
Sep 10 15:34:40.524568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:40.524530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-lqcpb" event={"ID":"6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2","Type":"ContainerStarted","Data":"274034c047f27b0af1ea3e038b086915c4735f0429329ce6eaf9bbd8fc52be12"}
Sep 10 15:34:43.643259 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:43.643217    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:43.735140 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:43.735099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:34:43.831557 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:34:43.831515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:05.714654 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:05.714616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:05.815351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:05.815311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:10.044242 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.044201    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:35:10.044750 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.044492    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="alertmanager" containerID="cri-o://1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d" gracePeriod=120
Sep 10 15:35:10.044750 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.044526    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy" containerID="cri-o://26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f" gracePeriod=120
Sep 10 15:35:10.044750 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.044565    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="config-reloader" containerID="cri-o://cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65" gracePeriod=120
Sep 10 15:35:10.044750 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.044583    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="prom-label-proxy" containerID="cri-o://3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e" gracePeriod=120
Sep 10 15:35:10.044750 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.044605    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy-metric" containerID="cri-o://9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f" gracePeriod=120
Sep 10 15:35:10.044750 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.044539    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy-web" containerID="cri-o://599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0" gracePeriod=120
Sep 10 15:35:10.650913 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.650872    2565 generic.go:356] "Generic (PLEG): container finished" podID="61e67d1b-497d-41f7-917e-112c5279c49d" containerID="3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e" exitCode=0
Sep 10 15:35:10.650913 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.650898    2565 generic.go:356] "Generic (PLEG): container finished" podID="61e67d1b-497d-41f7-917e-112c5279c49d" containerID="26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f" exitCode=0
Sep 10 15:35:10.650913 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.650908    2565 generic.go:356] "Generic (PLEG): container finished" podID="61e67d1b-497d-41f7-917e-112c5279c49d" containerID="cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65" exitCode=0
Sep 10 15:35:10.650913 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.650915    2565 generic.go:356] "Generic (PLEG): container finished" podID="61e67d1b-497d-41f7-917e-112c5279c49d" containerID="1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d" exitCode=0
Sep 10 15:35:10.651206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.650945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerDied","Data":"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e"}
Sep 10 15:35:10.651206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.651029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerDied","Data":"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f"}
Sep 10 15:35:10.651206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.651057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerDied","Data":"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65"}
Sep 10 15:35:10.651206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:10.651081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerDied","Data":"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d"}
Sep 10 15:35:11.280035 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.280008    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.427105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427279 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427115    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-main-tls\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427279 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-config-out\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427279 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427167    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-tls-assets\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427438 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427438 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzwrl\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-kube-api-access-nzwrl\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427438 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427400    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-main-db\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427588 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427475    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-config-volume\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427588 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427506    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-cluster-tls-config\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427588 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427533    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-web-config\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427588 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427560    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-metrics-client-ca\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427593    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-web\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.427807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.427638    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-trusted-ca-bundle\") pod \"61e67d1b-497d-41f7-917e-112c5279c49d\" (UID: \"61e67d1b-497d-41f7-917e-112c5279c49d\") "
Sep 10 15:35:11.428570 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.428318    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:35:11.430120 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.430081    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:35:11.430432 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.430408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-config-out" (OuterVolumeSpecName: "config-out") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:35:11.430524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.430443    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:35:11.430524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.430444    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:35:11.430754 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.430729    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:35:11.430867 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.430759    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:35:11.431151 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.431055    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:35:11.431221 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.431184    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-kube-api-access-nzwrl" (OuterVolumeSpecName: "kube-api-access-nzwrl") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "kube-api-access-nzwrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:35:11.432318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.432293    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:35:11.432487 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.432468    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-config-volume" (OuterVolumeSpecName: "config-volume") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:35:11.435106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.435075    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:35:11.441221 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.441197    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-web-config" (OuterVolumeSpecName: "web-config") pod "61e67d1b-497d-41f7-917e-112c5279c49d" (UID: "61e67d1b-497d-41f7-917e-112c5279c49d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:35:11.528770 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528725    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.528770 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528761    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzwrl\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-kube-api-access-nzwrl\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.528770 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528771    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-main-db\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.528770 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528781    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-config-volume\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528790    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-cluster-tls-config\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528799    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-web-config\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528807    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-metrics-client-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528816    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528826    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61e67d1b-497d-41f7-917e-112c5279c49d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528836    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528847    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61e67d1b-497d-41f7-917e-112c5279c49d-secret-alertmanager-main-tls\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528858    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61e67d1b-497d-41f7-917e-112c5279c49d-config-out\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.529070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.528867    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61e67d1b-497d-41f7-917e-112c5279c49d-tls-assets\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:35:11.658716 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.658680    2565 generic.go:356] "Generic (PLEG): container finished" podID="61e67d1b-497d-41f7-917e-112c5279c49d" containerID="9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f" exitCode=0
Sep 10 15:35:11.658716 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.658705    2565 generic.go:356] "Generic (PLEG): container finished" podID="61e67d1b-497d-41f7-917e-112c5279c49d" containerID="599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0" exitCode=0
Sep 10 15:35:11.658933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.658749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.658933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.658757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerDied","Data":"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f"}
Sep 10 15:35:11.658933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.658823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerDied","Data":"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0"}
Sep 10 15:35:11.658933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.658850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61e67d1b-497d-41f7-917e-112c5279c49d","Type":"ContainerDied","Data":"e569b9d30c0b9a9d985de3efb7fcc2686a624ef292842104266df8fda83a0bf6"}
Sep 10 15:35:11.658933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.658880    2565 scope.go:117] "RemoveContainer" containerID="3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e"
Sep 10 15:35:11.668032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.668009    2565 scope.go:117] "RemoveContainer" containerID="9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f"
Sep 10 15:35:11.675446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.675424    2565 scope.go:117] "RemoveContainer" containerID="26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f"
Sep 10 15:35:11.682415 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.682394    2565 scope.go:117] "RemoveContainer" containerID="599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0"
Sep 10 15:35:11.684462 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.684438    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:35:11.689999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.689971    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:35:11.692520 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.692501    2565 scope.go:117] "RemoveContainer" containerID="cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65"
Sep 10 15:35:11.699816 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.699798    2565 scope.go:117] "RemoveContainer" containerID="1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d"
Sep 10 15:35:11.707112 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.707081    2565 scope.go:117] "RemoveContainer" containerID="f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8"
Sep 10 15:35:11.714246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.714225    2565 scope.go:117] "RemoveContainer" containerID="3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e"
Sep 10 15:35:11.714525 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:35:11.714505    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e\": container with ID starting with 3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e not found: ID does not exist" containerID="3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e"
Sep 10 15:35:11.714586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.714536    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e"} err="failed to get container status \"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e\": rpc error: code = NotFound desc = could not find container \"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e\": container with ID starting with 3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e not found: ID does not exist"
Sep 10 15:35:11.714586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.714555    2565 scope.go:117] "RemoveContainer" containerID="9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f"
Sep 10 15:35:11.714856 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:35:11.714830    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f\": container with ID starting with 9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f not found: ID does not exist" containerID="9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f"
Sep 10 15:35:11.714911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.714861    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f"} err="failed to get container status \"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f\": rpc error: code = NotFound desc = could not find container \"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f\": container with ID starting with 9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f not found: ID does not exist"
Sep 10 15:35:11.714911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.714876    2565 scope.go:117] "RemoveContainer" containerID="26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f"
Sep 10 15:35:11.715168 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:35:11.715150    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f\": container with ID starting with 26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f not found: ID does not exist" containerID="26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f"
Sep 10 15:35:11.715211 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.715172    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f"} err="failed to get container status \"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f\": rpc error: code = NotFound desc = could not find container \"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f\": container with ID starting with 26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f not found: ID does not exist"
Sep 10 15:35:11.715211 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.715189    2565 scope.go:117] "RemoveContainer" containerID="599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0"
Sep 10 15:35:11.715437 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:35:11.715421    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0\": container with ID starting with 599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0 not found: ID does not exist" containerID="599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0"
Sep 10 15:35:11.715491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.715440    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0"} err="failed to get container status \"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0\": rpc error: code = NotFound desc = could not find container \"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0\": container with ID starting with 599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0 not found: ID does not exist"
Sep 10 15:35:11.715491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.715452    2565 scope.go:117] "RemoveContainer" containerID="cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65"
Sep 10 15:35:11.715681 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:35:11.715667    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65\": container with ID starting with cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65 not found: ID does not exist" containerID="cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65"
Sep 10 15:35:11.715720 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.715691    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65"} err="failed to get container status \"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65\": rpc error: code = NotFound desc = could not find container \"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65\": container with ID starting with cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65 not found: ID does not exist"
Sep 10 15:35:11.715720 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.715704    2565 scope.go:117] "RemoveContainer" containerID="1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d"
Sep 10 15:35:11.715979 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:35:11.715945    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d\": container with ID starting with 1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d not found: ID does not exist" containerID="1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d"
Sep 10 15:35:11.716060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.715977    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d"} err="failed to get container status \"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d\": rpc error: code = NotFound desc = could not find container \"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d\": container with ID starting with 1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d not found: ID does not exist"
Sep 10 15:35:11.716060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.715990    2565 scope.go:117] "RemoveContainer" containerID="f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8"
Sep 10 15:35:11.716233 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:35:11.716216    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8\": container with ID starting with f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8 not found: ID does not exist" containerID="f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8"
Sep 10 15:35:11.716325 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.716237    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8"} err="failed to get container status \"f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8\": rpc error: code = NotFound desc = could not find container \"f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8\": container with ID starting with f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8 not found: ID does not exist"
Sep 10 15:35:11.716325 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.716250    2565 scope.go:117] "RemoveContainer" containerID="3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e"
Sep 10 15:35:11.716501 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.716483    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e"} err="failed to get container status \"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e\": rpc error: code = NotFound desc = could not find container \"3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e\": container with ID starting with 3798b5ac3ce7804991b3dd66109b96300cfe4ecb4f8f61e9fb1b62a38e516a5e not found: ID does not exist"
Sep 10 15:35:11.716539 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.716510    2565 scope.go:117] "RemoveContainer" containerID="9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f"
Sep 10 15:35:11.716747 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.716732    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f"} err="failed to get container status \"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f\": rpc error: code = NotFound desc = could not find container \"9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f\": container with ID starting with 9ad747613272fa5184bf15fae617610141cf40a7f2d7dc0b240b4e38d8cd293f not found: ID does not exist"
Sep 10 15:35:11.716790 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.716748    2565 scope.go:117] "RemoveContainer" containerID="26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f"
Sep 10 15:35:11.717048 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.716984    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f"} err="failed to get container status \"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f\": rpc error: code = NotFound desc = could not find container \"26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f\": container with ID starting with 26b077063f4a710d4fd236a6ff67010b400e4edee386803f9a468906603e836f not found: ID does not exist"
Sep 10 15:35:11.717048 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.717005    2565 scope.go:117] "RemoveContainer" containerID="599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0"
Sep 10 15:35:11.717253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.717225    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0"} err="failed to get container status \"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0\": rpc error: code = NotFound desc = could not find container \"599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0\": container with ID starting with 599922755b5030241fe25bbed5d3f89c4149318130769e4a16e63ca797a622d0 not found: ID does not exist"
Sep 10 15:35:11.717295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.717254    2565 scope.go:117] "RemoveContainer" containerID="cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65"
Sep 10 15:35:11.717491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.717473    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65"} err="failed to get container status \"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65\": rpc error: code = NotFound desc = could not find container \"cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65\": container with ID starting with cd0c69ddf45937f3cc1dd69b3ed013c41f6c16283b6db98bb84bae9aea814c65 not found: ID does not exist"
Sep 10 15:35:11.717615 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.717492    2565 scope.go:117] "RemoveContainer" containerID="1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d"
Sep 10 15:35:11.717680 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.717641    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d"} err="failed to get container status \"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d\": rpc error: code = NotFound desc = could not find container \"1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d\": container with ID starting with 1db080f6b4d28b273a079c47466573d39bd78738fc51ef7a228cd976d29d172d not found: ID does not exist"
Sep 10 15:35:11.717680 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.717654    2565 scope.go:117] "RemoveContainer" containerID="f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8"
Sep 10 15:35:11.718087 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.718006    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8"} err="failed to get container status \"f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8\": rpc error: code = NotFound desc = could not find container \"f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8\": container with ID starting with f6c4ea5644e4dec3ce077978a12f482608aae3b06a6e8baf5acaf799da4e16c8 not found: ID does not exist"
Sep 10 15:35:11.719700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.719681    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:35:11.720050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720019    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy-metric"
Sep 10 15:35:11.720050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720038    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy-metric"
Sep 10 15:35:11.720050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720049    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="config-reloader"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720056    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="config-reloader"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720063    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="prom-label-proxy"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720069    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="prom-label-proxy"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720078    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f110e2b-f9d1-40ee-be56-1a96cd99a43b" containerName="console"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720084    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f110e2b-f9d1-40ee-be56-1a96cd99a43b" containerName="console"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720096    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="alertmanager"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720103    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="alertmanager"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720112    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b995ff5-f42a-4fa3-8e00-d2f90a02decf" containerName="registry"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720117    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b995ff5-f42a-4fa3-8e00-d2f90a02decf" containerName="registry"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720127    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720132    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720138    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy-web"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720143    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy-web"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720158    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="init-config-reloader"
Sep 10 15:35:11.720173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720163    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="init-config-reloader"
Sep 10 15:35:11.720573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720213    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="prom-label-proxy"
Sep 10 15:35:11.720573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720222    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="config-reloader"
Sep 10 15:35:11.720573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720228    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy-metric"
Sep 10 15:35:11.720573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720235    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="alertmanager"
Sep 10 15:35:11.720573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720241    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b995ff5-f42a-4fa3-8e00-d2f90a02decf" containerName="registry"
Sep 10 15:35:11.720573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720249    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy"
Sep 10 15:35:11.720573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720258    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f110e2b-f9d1-40ee-be56-1a96cd99a43b" containerName="console"
Sep 10 15:35:11.720573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.720265    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" containerName="kube-rbac-proxy-web"
Sep 10 15:35:11.725159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.725143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.727644 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.727625    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 15:35:11.727890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.727860    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 15:35:11.727890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.727879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 15:35:11.728064 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.727879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 15:35:11.728064 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.727901    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 15:35:11.728349 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.728328    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 15:35:11.728459 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.728365    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 15:35:11.728527 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.728461    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 15:35:11.728586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.728567    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5zkzz\""
Sep 10 15:35:11.737236 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.737205    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 15:35:11.741422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.741396    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:35:11.823106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.823071    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61e67d1b-497d-41f7-917e-112c5279c49d" path="/var/lib/kubelet/pods/61e67d1b-497d-41f7-917e-112c5279c49d/volumes"
Sep 10 15:35:11.833362 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833475 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833475 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833475 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff19772-cf19-4ceb-9e33-6927227af513-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-web-config\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bff19772-cf19-4ceb-9e33-6927227af513-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-config-volume\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833834 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bff19772-cf19-4ceb-9e33-6927227af513-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833834 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bff19772-cf19-4ceb-9e33-6927227af513-config-out\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833834 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.833834 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bff19772-cf19-4ceb-9e33-6927227af513-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.834013 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.833848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj2qb\" (UniqueName: \"kubernetes.io/projected/bff19772-cf19-4ceb-9e33-6927227af513-kube-api-access-hj2qb\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935214 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bff19772-cf19-4ceb-9e33-6927227af513-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935214 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj2qb\" (UniqueName: \"kubernetes.io/projected/bff19772-cf19-4ceb-9e33-6927227af513-kube-api-access-hj2qb\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935214 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935214 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff19772-cf19-4ceb-9e33-6927227af513-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-web-config\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bff19772-cf19-4ceb-9e33-6927227af513-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-config-volume\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935850 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bff19772-cf19-4ceb-9e33-6927227af513-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935850 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bff19772-cf19-4ceb-9e33-6927227af513-config-out\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.935850 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.936022 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.935925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bff19772-cf19-4ceb-9e33-6927227af513-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.936820 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.936790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bff19772-cf19-4ceb-9e33-6927227af513-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.936938 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.936912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff19772-cf19-4ceb-9e33-6927227af513-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.938711 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.938676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.938814 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.938717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bff19772-cf19-4ceb-9e33-6927227af513-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.938814 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.938772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-web-config\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.938983 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.938938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.939101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.939077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.939189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.939156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.939326 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.939307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-config-volume\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.939452 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.939436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bff19772-cf19-4ceb-9e33-6927227af513-config-out\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.940081 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.940065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bff19772-cf19-4ceb-9e33-6927227af513-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:11.943032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:11.943012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj2qb\" (UniqueName: \"kubernetes.io/projected/bff19772-cf19-4ceb-9e33-6927227af513-kube-api-access-hj2qb\") pod \"alertmanager-main-0\" (UID: \"bff19772-cf19-4ceb-9e33-6927227af513\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:12.037318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:12.037280    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 15:35:12.316723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:12.316694    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 15:35:12.319046 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:35:12.319019    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff19772_cf19_4ceb_9e33_6927227af513.slice/crio-11c59bf789f92dd0de83eba861fe9cf76fbbd83b38debfba68a915672fd040dd WatchSource:0}: Error finding container 11c59bf789f92dd0de83eba861fe9cf76fbbd83b38debfba68a915672fd040dd: Status 404 returned error can't find the container with id 11c59bf789f92dd0de83eba861fe9cf76fbbd83b38debfba68a915672fd040dd
Sep 10 15:35:12.664285 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:12.664253    2565 generic.go:356] "Generic (PLEG): container finished" podID="bff19772-cf19-4ceb-9e33-6927227af513" containerID="9f84353d51b249994e16a965d1fb76f5231196314cf7139c1781b6b420c81e2f" exitCode=0
Sep 10 15:35:12.664494 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:12.664349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bff19772-cf19-4ceb-9e33-6927227af513","Type":"ContainerDied","Data":"9f84353d51b249994e16a965d1fb76f5231196314cf7139c1781b6b420c81e2f"}
Sep 10 15:35:12.664494 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:12.664424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bff19772-cf19-4ceb-9e33-6927227af513","Type":"ContainerStarted","Data":"11c59bf789f92dd0de83eba861fe9cf76fbbd83b38debfba68a915672fd040dd"}
Sep 10 15:35:13.673253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:13.673216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bff19772-cf19-4ceb-9e33-6927227af513","Type":"ContainerStarted","Data":"ea5b38a639b207da40b91d015c3c1b8e9b39aa194a362c274d99fa38241d2d74"}
Sep 10 15:35:13.673632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:13.673285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bff19772-cf19-4ceb-9e33-6927227af513","Type":"ContainerStarted","Data":"c7f385a5dac482b60a69272432fff6471fd2f23db373f119bffc3bf9e3e821ec"}
Sep 10 15:35:13.673632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:13.673319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bff19772-cf19-4ceb-9e33-6927227af513","Type":"ContainerStarted","Data":"83cfb6c4ddf7b70ac3f07406f3ce6d71fffcf3e8119ae629296d06f07830f29f"}
Sep 10 15:35:13.673632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:13.673350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bff19772-cf19-4ceb-9e33-6927227af513","Type":"ContainerStarted","Data":"951c52abe8eb048286051f1ed4c3fe1001b9ead4c894e5002b817f6840e48b2f"}
Sep 10 15:35:13.673632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:13.673376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bff19772-cf19-4ceb-9e33-6927227af513","Type":"ContainerStarted","Data":"d3431edc5e64a01139e94cc91cdf33137c8d60bde58daf63ab98b3af7a1d752f"}
Sep 10 15:35:13.673632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:13.673400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bff19772-cf19-4ceb-9e33-6927227af513","Type":"ContainerStarted","Data":"49a9223b414c03fffdde28b1d6b7d5a934e31517e5d2d4d4e2529a315c4babbf"}
Sep 10 15:35:13.708943 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:13.708890    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6930987870000003 podStartE2EDuration="2.708873217s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.77443ms" isStatefulPod=false podCreationTimestamp="2026-09-10 15:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:35:13.706324905 +0000 UTC m=+190.521400646" watchObservedRunningTime="2026-09-10 15:35:13.708873217 +0000 UTC m=+190.523948957"
Sep 10 15:35:17.630470 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:17.630436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:17.688305 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:17.688264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:32.616723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:32.616677    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:32.712145 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:32.712099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:33.419722 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.419688    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7795797b5b-q84hq"]
Sep 10 15:35:33.423081 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.423056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.425796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.425771    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 15:35:33.425796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.425782    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 15:35:33.426870 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.426850    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 15:35:33.426993 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.426874    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 15:35:33.426993 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.426915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 15:35:33.426993 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.426987    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 15:35:33.427138 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.427070    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jdlj5\""
Sep 10 15:35:33.427184 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.427172    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 15:35:33.435803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.435780    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 15:35:33.436511 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.436490    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7795797b5b-q84hq"]
Sep 10 15:35:33.484694 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.484658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:33.515808 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.515780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-service-ca\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.515946 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.515816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-trusted-ca-bundle\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.515946 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.515849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-oauth-serving-cert\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.515946 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.515913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-serving-cert\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.516074 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.515951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t78n\" (UniqueName: \"kubernetes.io/projected/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-kube-api-access-8t78n\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.516074 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.515988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-config\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.516074 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.516007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-oauth-config\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.539344 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.539312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:33.617286 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.617253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-oauth-serving-cert\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.617736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.617293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-serving-cert\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.617736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.617327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t78n\" (UniqueName: \"kubernetes.io/projected/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-kube-api-access-8t78n\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.617736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.617356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-config\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.617736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.617381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-oauth-config\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.617736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.617450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-service-ca\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.617736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.617481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-trusted-ca-bundle\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.618185 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.618160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-oauth-serving-cert\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.618241 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.618176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-config\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.618282 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.618236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-service-ca\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.618542 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.618525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-trusted-ca-bundle\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.619814 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.619793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-serving-cert\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.619906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.619875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-oauth-config\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.626338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.626318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t78n\" (UniqueName: \"kubernetes.io/projected/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-kube-api-access-8t78n\") pod \"console-7795797b5b-q84hq\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") " pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:33.733039 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:33.732924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:34.004600 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:34.004575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7795797b5b-q84hq"]
Sep 10 15:35:34.007206 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:35:34.007173    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fcc2cc_d2fc_4f2f_990e_fecbf8ba0e00.slice/crio-42f7154201a181adb0e6ae864633e8ed475992afd103bf0eaf30f03ec2316b1c WatchSource:0}: Error finding container 42f7154201a181adb0e6ae864633e8ed475992afd103bf0eaf30f03ec2316b1c: Status 404 returned error can't find the container with id 42f7154201a181adb0e6ae864633e8ed475992afd103bf0eaf30f03ec2316b1c
Sep 10 15:35:34.761045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:34.761012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7795797b5b-q84hq" event={"ID":"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00","Type":"ContainerStarted","Data":"9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e"}
Sep 10 15:35:34.761434 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:34.761069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7795797b5b-q84hq" event={"ID":"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00","Type":"ContainerStarted","Data":"42f7154201a181adb0e6ae864633e8ed475992afd103bf0eaf30f03ec2316b1c"}
Sep 10 15:35:34.780709 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:34.780655    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7795797b5b-q84hq" podStartSLOduration=1.780640899 podStartE2EDuration="1.780640899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:35:34.778672348 +0000 UTC m=+211.593748088" watchObservedRunningTime="2026-09-10 15:35:34.780640899 +0000 UTC m=+211.595716639"
Sep 10 15:35:43.734128 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:43.734069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:43.734735 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:43.734155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:43.738916 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:43.738889    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:43.800475 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:43.800449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:35:43.945509 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:43.945476    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:44.047752 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:44.047654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:35:44.105876 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:35:44.105843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:10.480792 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:10.480745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:11.479762 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:11.479715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:11.549617 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:11.549577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:33.014148 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:33.014068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:34.366012 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:34.365954    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:34.966351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:34.966305    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"]
Sep 10 15:36:34.969725 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:34.969701    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"
Sep 10 15:36:34.972202 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:34.972180    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:36:34.972304 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:34.972202    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p798h\""
Sep 10 15:36:34.972304 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:34.972202    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 15:36:34.981394 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:34.981371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"]
Sep 10 15:36:35.033251 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.033225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gxvfr\" (UID: \"e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"
Sep 10 15:36:35.033400 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.033261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5txcr\" (UniqueName: \"kubernetes.io/projected/e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1-kube-api-access-5txcr\") pod \"cert-manager-operator-controller-manager-55c444bf86-gxvfr\" (UID: \"e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"
Sep 10 15:36:35.134657 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.134625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gxvfr\" (UID: \"e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"
Sep 10 15:36:35.134786 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.134667    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5txcr\" (UniqueName: \"kubernetes.io/projected/e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1-kube-api-access-5txcr\") pod \"cert-manager-operator-controller-manager-55c444bf86-gxvfr\" (UID: \"e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"
Sep 10 15:36:35.135105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.135086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gxvfr\" (UID: \"e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"
Sep 10 15:36:35.143492 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.143473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5txcr\" (UniqueName: \"kubernetes.io/projected/e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1-kube-api-access-5txcr\") pod \"cert-manager-operator-controller-manager-55c444bf86-gxvfr\" (UID: \"e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"
Sep 10 15:36:35.279284 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.279198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"
Sep 10 15:36:35.553946 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.553917    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr"]
Sep 10 15:36:35.555286 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:36:35.555259    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cfde67_a1aa_4c7b_bdce_bb1e803fdef1.slice/crio-a7895cdef9bc17cf5fb88012c160ae95cf0af763dd021c09124e2ef87458960c WatchSource:0}: Error finding container a7895cdef9bc17cf5fb88012c160ae95cf0af763dd021c09124e2ef87458960c: Status 404 returned error can't find the container with id a7895cdef9bc17cf5fb88012c160ae95cf0af763dd021c09124e2ef87458960c
Sep 10 15:36:35.993652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:35.993617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr" event={"ID":"e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1","Type":"ContainerStarted","Data":"a7895cdef9bc17cf5fb88012c160ae95cf0af763dd021c09124e2ef87458960c"}
Sep 10 15:36:36.620743 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:36.620633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:36.682935 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:36.682833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:38.832743 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:38.832707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:38.926801 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:38.926751    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:39.011835 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:39.011796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr" event={"ID":"e8cfde67-a1aa-4c7b-bdce-bb1e803fdef1","Type":"ContainerStarted","Data":"92f559fe50861d718c882bf8b090e7055126e39436c1bf4f6be3999ee7a09460"}
Sep 10 15:36:39.031508 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:39.031464    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gxvfr" podStartSLOduration=2.576611336 podStartE2EDuration="5.031449187s" totalImagesPullingTime="2.454837851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:36:39.030210861 +0000 UTC m=+275.845286641" watchObservedRunningTime="2026-09-10 15:36:39.031449187 +0000 UTC m=+275.846524944"
Sep 10 15:36:39.566244 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:39.566202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:39.664468 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:39.664426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:41.032402 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:41.032326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:41.661337 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:41.661303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:43.618005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:43.617956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:43.679869 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:43.679834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:46.991364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:46.991331    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"]
Sep 10 15:36:46.994846 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:46.994826    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"
Sep 10 15:36:46.997489 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:46.997463    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 15:36:46.998264 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:46.998243    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 15:36:46.998344 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:46.998244    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pc4ds\""
Sep 10 15:36:47.004671 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.004644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"]
Sep 10 15:36:47.140248 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.140201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmm9l\" (UniqueName: \"kubernetes.io/projected/6223f0dd-a55a-4c34-a552-b9e7af159b36-kube-api-access-qmm9l\") pod \"cert-manager-cainjector-559cdd8c87-cfgtb\" (UID: \"6223f0dd-a55a-4c34-a552-b9e7af159b36\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"
Sep 10 15:36:47.140248 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.140252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6223f0dd-a55a-4c34-a552-b9e7af159b36-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfgtb\" (UID: \"6223f0dd-a55a-4c34-a552-b9e7af159b36\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"
Sep 10 15:36:47.240678 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.240621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmm9l\" (UniqueName: \"kubernetes.io/projected/6223f0dd-a55a-4c34-a552-b9e7af159b36-kube-api-access-qmm9l\") pod \"cert-manager-cainjector-559cdd8c87-cfgtb\" (UID: \"6223f0dd-a55a-4c34-a552-b9e7af159b36\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"
Sep 10 15:36:47.240876 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.240690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6223f0dd-a55a-4c34-a552-b9e7af159b36-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfgtb\" (UID: \"6223f0dd-a55a-4c34-a552-b9e7af159b36\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"
Sep 10 15:36:47.252249 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.252181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6223f0dd-a55a-4c34-a552-b9e7af159b36-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cfgtb\" (UID: \"6223f0dd-a55a-4c34-a552-b9e7af159b36\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"
Sep 10 15:36:47.252388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.252302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmm9l\" (UniqueName: \"kubernetes.io/projected/6223f0dd-a55a-4c34-a552-b9e7af159b36-kube-api-access-qmm9l\") pod \"cert-manager-cainjector-559cdd8c87-cfgtb\" (UID: \"6223f0dd-a55a-4c34-a552-b9e7af159b36\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"
Sep 10 15:36:47.304924 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.304880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"
Sep 10 15:36:47.575823 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:47.575795    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb"]
Sep 10 15:36:47.578461 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:36:47.578426    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6223f0dd_a55a_4c34_a552_b9e7af159b36.slice/crio-dd84baf99ea7e2a17d23e7a7be8ede7ae1292fd1136ffeeb59bb1ffbe7af6dfe WatchSource:0}: Error finding container dd84baf99ea7e2a17d23e7a7be8ede7ae1292fd1136ffeeb59bb1ffbe7af6dfe: Status 404 returned error can't find the container with id dd84baf99ea7e2a17d23e7a7be8ede7ae1292fd1136ffeeb59bb1ffbe7af6dfe
Sep 10 15:36:48.058025 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:48.057986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb" event={"ID":"6223f0dd-a55a-4c34-a552-b9e7af159b36","Type":"ContainerStarted","Data":"dd84baf99ea7e2a17d23e7a7be8ede7ae1292fd1136ffeeb59bb1ffbe7af6dfe"}
Sep 10 15:36:49.637012 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:49.636941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:50.628509 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:50.628462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:50.724667 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:50.724629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:50.852325 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:50.852290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:50.953103 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:50.953057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:51.073544 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:51.073510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb" event={"ID":"6223f0dd-a55a-4c34-a552-b9e7af159b36","Type":"ContainerStarted","Data":"c6b9a3256321de6973e6b2aedec5923c96dfb588ecb417805c0d645791b792c4"}
Sep 10 15:36:51.093524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:51.093475    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cfgtb" podStartSLOduration=2.611983676 podStartE2EDuration="5.093460672s" totalImagesPullingTime="2.481476996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:36:51.091711797 +0000 UTC m=+287.906787540" watchObservedRunningTime="2026-09-10 15:36:51.093460672 +0000 UTC m=+287.908536411"
Sep 10 15:36:56.736543 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:56.736494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:56.849232 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:56.849187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:58.849237 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:58.849200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:59.402714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.402682    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z42vb"]
Sep 10 15:36:59.406053 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.406035    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-z42vb"
Sep 10 15:36:59.408600 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.408579    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-442s8\""
Sep 10 15:36:59.416929 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.416906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z42vb"]
Sep 10 15:36:59.527104 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.527070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:36:59.546170 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.546130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p4hw\" (UniqueName: \"kubernetes.io/projected/e0058792-932e-4ec8-81b4-4e4e0c616a35-kube-api-access-2p4hw\") pod \"cert-manager-55b4d954d5-z42vb\" (UID: \"e0058792-932e-4ec8-81b4-4e4e0c616a35\") " pod="cert-manager/cert-manager-55b4d954d5-z42vb"
Sep 10 15:36:59.546338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.546201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0058792-932e-4ec8-81b4-4e4e0c616a35-bound-sa-token\") pod \"cert-manager-55b4d954d5-z42vb\" (UID: \"e0058792-932e-4ec8-81b4-4e4e0c616a35\") " pod="cert-manager/cert-manager-55b4d954d5-z42vb"
Sep 10 15:36:59.647504 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.647461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p4hw\" (UniqueName: \"kubernetes.io/projected/e0058792-932e-4ec8-81b4-4e4e0c616a35-kube-api-access-2p4hw\") pod \"cert-manager-55b4d954d5-z42vb\" (UID: \"e0058792-932e-4ec8-81b4-4e4e0c616a35\") " pod="cert-manager/cert-manager-55b4d954d5-z42vb"
Sep 10 15:36:59.647672 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.647539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0058792-932e-4ec8-81b4-4e4e0c616a35-bound-sa-token\") pod \"cert-manager-55b4d954d5-z42vb\" (UID: \"e0058792-932e-4ec8-81b4-4e4e0c616a35\") " pod="cert-manager/cert-manager-55b4d954d5-z42vb"
Sep 10 15:36:59.656289 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.656214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0058792-932e-4ec8-81b4-4e4e0c616a35-bound-sa-token\") pod \"cert-manager-55b4d954d5-z42vb\" (UID: \"e0058792-932e-4ec8-81b4-4e4e0c616a35\") " pod="cert-manager/cert-manager-55b4d954d5-z42vb"
Sep 10 15:36:59.656434 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.656413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p4hw\" (UniqueName: \"kubernetes.io/projected/e0058792-932e-4ec8-81b4-4e4e0c616a35-kube-api-access-2p4hw\") pod \"cert-manager-55b4d954d5-z42vb\" (UID: \"e0058792-932e-4ec8-81b4-4e4e0c616a35\") " pod="cert-manager/cert-manager-55b4d954d5-z42vb"
Sep 10 15:36:59.715019 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.714980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-z42vb"
Sep 10 15:36:59.989877 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:36:59.989853    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z42vb"]
Sep 10 15:36:59.991542 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:36:59.991515    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0058792_932e_4ec8_81b4_4e4e0c616a35.slice/crio-aaf937914f6feae3e01980c95f8260b572335845cd985e42ce68b312f25484b3 WatchSource:0}: Error finding container aaf937914f6feae3e01980c95f8260b572335845cd985e42ce68b312f25484b3: Status 404 returned error can't find the container with id aaf937914f6feae3e01980c95f8260b572335845cd985e42ce68b312f25484b3
Sep 10 15:37:00.116384 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:00.116347    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-z42vb" event={"ID":"e0058792-932e-4ec8-81b4-4e4e0c616a35","Type":"ContainerStarted","Data":"ab7f51731dfd1b07542c56d84ff7709774a1f8327054a0f5da3bb157d5c8a7b7"}
Sep 10 15:37:00.116384 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:00.116388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-z42vb" event={"ID":"e0058792-932e-4ec8-81b4-4e4e0c616a35","Type":"ContainerStarted","Data":"aaf937914f6feae3e01980c95f8260b572335845cd985e42ce68b312f25484b3"}
Sep 10 15:37:00.136319 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:00.136267    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-z42vb" podStartSLOduration=1.136248381 podStartE2EDuration="1.136248381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:37:00.134631515 +0000 UTC m=+296.949707257" watchObservedRunningTime="2026-09-10 15:37:00.136248381 +0000 UTC m=+296.951324133"
Sep 10 15:37:03.599735 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:03.599707    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:37:03.610710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:03.605910    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 15:37:03.612130 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:03.612104    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:37:16.160940 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:16.160896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:16.264320 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:16.264280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:16.853158 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:16.853092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:17.129274 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.129187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:17.224944 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.224903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:17.254059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.254027    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"]
Sep 10 15:37:17.257451 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.257433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.260042 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.260021    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 15:37:17.260254 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.260239    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 15:37:17.260569 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.260549    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 15:37:17.260655 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.260551    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m59ll\""
Sep 10 15:37:17.260655 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.260552    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 15:37:17.277477 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.277447    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"]
Sep 10 15:37:17.392353 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.392265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-manifests\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.392353 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.392325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-tmp\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.392547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.392356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrkjk\" (UniqueName: \"kubernetes.io/projected/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-kube-api-access-vrkjk\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.392547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.392409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.392547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.392437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.405119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.405082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:17.493636 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.493606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-tmp\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.493761 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.493638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrkjk\" (UniqueName: \"kubernetes.io/projected/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-kube-api-access-vrkjk\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.493761 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.493671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.493761 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.493694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.493761 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.493754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-manifests\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.494153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.494131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-manifests\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.496094 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.496071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-tmp\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.496201 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.496122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.496255 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.496201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.504188 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.504167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrkjk\" (UniqueName: \"kubernetes.io/projected/03a67e64-4565-4af7-bfe9-acfe7fe6d5b4-kube-api-access-vrkjk\") pod \"opendatahub-operator-controller-manager-9f4cd445f-8xwcd\" (UID: \"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4\") " pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.509247 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.509221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:17.567826 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.567807    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:17.605905 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.605873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:17.707841 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.707815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:17.808613 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.808588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:17.844796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.844770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"]
Sep 10 15:37:17.847331 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:37:17.847310    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a67e64_4565_4af7_bfe9_acfe7fe6d5b4.slice/crio-389617a615cbafdb03bde682ea29baa3f6620f97985661bc5eeae596f119fe65 WatchSource:0}: Error finding container 389617a615cbafdb03bde682ea29baa3f6620f97985661bc5eeae596f119fe65: Status 404 returned error can't find the container with id 389617a615cbafdb03bde682ea29baa3f6620f97985661bc5eeae596f119fe65
Sep 10 15:37:17.848981 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:17.848950    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:37:18.197587 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:18.197555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd" event={"ID":"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4","Type":"ContainerStarted","Data":"389617a615cbafdb03bde682ea29baa3f6620f97985661bc5eeae596f119fe65"}
Sep 10 15:37:22.218102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:22.218063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd" event={"ID":"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4","Type":"ContainerStarted","Data":"352b8606367e2d6ec1491e2c01b124f74dd7956286faf5b5a9f2c6e06b1dde1f"}
Sep 10 15:37:23.223661 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:23.223626    2565 generic.go:356] "Generic (PLEG): container finished" podID="03a67e64-4565-4af7-bfe9-acfe7fe6d5b4" containerID="352b8606367e2d6ec1491e2c01b124f74dd7956286faf5b5a9f2c6e06b1dde1f" exitCode=0
Sep 10 15:37:23.224070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:23.223715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd" event={"ID":"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4","Type":"ContainerDied","Data":"352b8606367e2d6ec1491e2c01b124f74dd7956286faf5b5a9f2c6e06b1dde1f"}
Sep 10 15:37:24.230466 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:24.230434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd" event={"ID":"03a67e64-4565-4af7-bfe9-acfe7fe6d5b4","Type":"ContainerStarted","Data":"30c6905dfbf890e40d2a8237b5cae16f7f18b148515fa6881125a63e69f6fb40"}
Sep 10 15:37:24.230927 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:24.230553    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:24.254525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:24.254475    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd" podStartSLOduration=2.33731584 podStartE2EDuration="7.254461181s" totalImagesPullingTime="3.87994801s" totalInitContainerRuntime="1.037197331s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:37:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:37:24.2527762 +0000 UTC m=+321.067851941" watchObservedRunningTime="2026-09-10 15:37:24.254461181 +0000 UTC m=+321.069536921"
Sep 10 15:37:27.384974 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:27.384918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:27.495173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:27.495128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:29.968940 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:29.968910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:31.803934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:31.803898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:35.236578 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:35.236547    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9f4cd445f-8xwcd"
Sep 10 15:37:36.922121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:36.922083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:37.224114 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.224025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:37.410981 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.410931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:37.465587 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.465554    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"]
Sep 10 15:37:37.472884 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.472863    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.475886 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.475823    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 15:37:37.476050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.476031    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jnvz2\""
Sep 10 15:37:37.476124 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.476077    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 15:37:37.485372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.485353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"]
Sep 10 15:37:37.574517 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.574484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5966a0-9a10-4dca-b54a-30f8a8804822-tmp\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.574517 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.574519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsm4k\" (UniqueName: \"kubernetes.io/projected/7d5966a0-9a10-4dca-b54a-30f8a8804822-kube-api-access-fsm4k\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.574688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.574575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d5966a0-9a10-4dca-b54a-30f8a8804822-tls-certs\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.675290 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.675256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsm4k\" (UniqueName: \"kubernetes.io/projected/7d5966a0-9a10-4dca-b54a-30f8a8804822-kube-api-access-fsm4k\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.675438 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.675314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d5966a0-9a10-4dca-b54a-30f8a8804822-tls-certs\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.675438 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.675369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5966a0-9a10-4dca-b54a-30f8a8804822-tmp\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.675513 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:37:37.675479    2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 15:37:37.675568 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:37:37.675556    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5966a0-9a10-4dca-b54a-30f8a8804822-tls-certs podName:7d5966a0-9a10-4dca-b54a-30f8a8804822 nodeName:}" failed. No retries permitted until 2026-09-10 15:37:38.175536394 +0000 UTC m=+334.990612116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7d5966a0-9a10-4dca-b54a-30f8a8804822-tls-certs") pod "kube-auth-proxy-b5b58d48c-sjl65" (UID: "7d5966a0-9a10-4dca-b54a-30f8a8804822") : secret "kube-auth-proxy-tls" not found
Sep 10 15:37:37.677608 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.677579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5966a0-9a10-4dca-b54a-30f8a8804822-tmp\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.686392 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.686371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsm4k\" (UniqueName: \"kubernetes.io/projected/7d5966a0-9a10-4dca-b54a-30f8a8804822-kube-api-access-fsm4k\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:37.782951 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:37.782878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:38.179626 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:38.179594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d5966a0-9a10-4dca-b54a-30f8a8804822-tls-certs\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:38.182011 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:38.181988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d5966a0-9a10-4dca-b54a-30f8a8804822-tls-certs\") pod \"kube-auth-proxy-b5b58d48c-sjl65\" (UID: \"7d5966a0-9a10-4dca-b54a-30f8a8804822\") " pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:38.382619 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:38.382590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"
Sep 10 15:37:38.690939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:38.690913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65"]
Sep 10 15:37:38.692912 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:37:38.692879    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5966a0_9a10_4dca_b54a_30f8a8804822.slice/crio-d0d66d48c0d3b521490aba49b0c7620d28d4fdf39824ee241e26b982767e8611 WatchSource:0}: Error finding container d0d66d48c0d3b521490aba49b0c7620d28d4fdf39824ee241e26b982767e8611: Status 404 returned error can't find the container with id d0d66d48c0d3b521490aba49b0c7620d28d4fdf39824ee241e26b982767e8611
Sep 10 15:37:39.081573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:39.081486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:39.222016 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:39.221942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:39.297705 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:39.297674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65" event={"ID":"7d5966a0-9a10-4dca-b54a-30f8a8804822","Type":"ContainerStarted","Data":"d0d66d48c0d3b521490aba49b0c7620d28d4fdf39824ee241e26b982767e8611"}
Sep 10 15:37:40.318082 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:40.318038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:42.314307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:42.314264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65" event={"ID":"7d5966a0-9a10-4dca-b54a-30f8a8804822","Type":"ContainerStarted","Data":"53122ec0c2c811198098b4d0ad86f819237241b34ba48a7b65f74c5c6923045a"}
Sep 10 15:37:42.331642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:42.331590    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b5b58d48c-sjl65" podStartSLOduration=2.406492819 podStartE2EDuration="5.331572329s" totalImagesPullingTime="2.92507951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:37:42.330087557 +0000 UTC m=+339.145163298" watchObservedRunningTime="2026-09-10 15:37:42.331572329 +0000 UTC m=+339.146648069"
Sep 10 15:37:43.900243 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.900212    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-556d846896-qftrq"]
Sep 10 15:37:43.903484 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.903465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:43.907259 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.907204    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 15:37:43.907259 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.907222    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 15:37:43.907259 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.907229    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 15:37:43.907493 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.907271    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 15:37:43.907493 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.907231    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 15:37:43.907493 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.907223    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p6p25\""
Sep 10 15:37:43.914729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:43.914708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-556d846896-qftrq"]
Sep 10 15:37:44.030187 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.030139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plm4n\" (UniqueName: \"kubernetes.io/projected/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-kube-api-access-plm4n\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.030187 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.030211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-metrics-cert\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.030467 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.030299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-manager-config\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.030467 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.030389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-cert\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.131073 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.131031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plm4n\" (UniqueName: \"kubernetes.io/projected/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-kube-api-access-plm4n\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.131219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.131105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-metrics-cert\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.131219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.131154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-manager-config\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.131219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.131214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-cert\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.131891 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.131865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-manager-config\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.133599 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.133567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-cert\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.133709 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.133623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-metrics-cert\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.138346 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.138323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plm4n\" (UniqueName: \"kubernetes.io/projected/e170054f-0a47-4b5d-9c32-d5ceee6d55e2-kube-api-access-plm4n\") pod \"lws-controller-manager-556d846896-qftrq\" (UID: \"e170054f-0a47-4b5d-9c32-d5ceee6d55e2\") " pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.200886 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.200820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:44.213073 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.213050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:44.319605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.319570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:44.491763 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.491667    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-556d846896-qftrq"]
Sep 10 15:37:44.494551 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:37:44.494526    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode170054f_0a47_4b5d_9c32_d5ceee6d55e2.slice/crio-887b0403b566765941e21c4d7ad174f05872c206e7fbdc04d1e938c92fe2e9f1 WatchSource:0}: Error finding container 887b0403b566765941e21c4d7ad174f05872c206e7fbdc04d1e938c92fe2e9f1: Status 404 returned error can't find the container with id 887b0403b566765941e21c4d7ad174f05872c206e7fbdc04d1e938c92fe2e9f1
Sep 10 15:37:44.510248 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.510220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:44.618643 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:44.618612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:45.044412 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:45.044373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:45.329400 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:45.329322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq" event={"ID":"e170054f-0a47-4b5d-9c32-d5ceee6d55e2","Type":"ContainerStarted","Data":"887b0403b566765941e21c4d7ad174f05872c206e7fbdc04d1e938c92fe2e9f1"}
Sep 10 15:37:47.341247 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:47.341148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq" event={"ID":"e170054f-0a47-4b5d-9c32-d5ceee6d55e2","Type":"ContainerStarted","Data":"d7d65192c08a1d2f50a9e27b4a788d595b9c05dcc7aec3c21ca068b2391df320"}
Sep 10 15:37:47.341247 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:47.341215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:47.358340 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:47.358289    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq" podStartSLOduration=1.835472548 podStartE2EDuration="4.358274842s" totalImagesPullingTime="2.522802294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:37:47.357549217 +0000 UTC m=+344.172624982" watchObservedRunningTime="2026-09-10 15:37:47.358274842 +0000 UTC m=+344.173350579"
Sep 10 15:37:48.267386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:48.267343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:48.370155 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:48.370118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:48.485320 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:48.485294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:48.768557 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:48.768522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:48.945068 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:48.945036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:55.578503 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:55.578464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:55.679158 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:55.679118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:58.347526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:58.347451    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-556d846896-qftrq"
Sep 10 15:37:58.793159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:58.793100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:58.943206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:58.943170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:59.206101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:59.206065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:37:59.306828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:37:59.306794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:38:00.156415 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:38:00.156382    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:38:00.291627 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:38:00.291595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:38:05.513140 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:38:05.513104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:38:49.117583 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:38:49.117533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:38:49.250861 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:38:49.250826    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:03.831110 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:03.831074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:05.110036 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:05.109995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:07.568449 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:07.568410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:07.668982 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:07.668917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:09.466160 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:09.466127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:12.440753 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:12.440717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:15.036267 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:15.036227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:15.644022 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:15.643987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:16.247639 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:16.247594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:21.902367 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:21.902332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:22.155651 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:22.155565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:22.270802 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:22.270769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:22.656728 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:22.656697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:22.757305 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:22.757260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:23.131776 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:23.131682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:24.478125 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:24.478086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:25.619521 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:25.619486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:25.722714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:25.722683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:25.862768 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:25.862733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:27.555053 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.554948    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"]
Sep 10 15:39:27.555634 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.555601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:27.558485 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.558469    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.561041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.561020    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 15:39:27.561645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.561622    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 15:39:27.562120 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.562102    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 15:39:27.562183 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.562116    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n4c6m\""
Sep 10 15:39:27.562183 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.562104    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 15:39:27.567449 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.567426    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"]
Sep 10 15:39:27.614405 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.614374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30220f6d-2e4f-478c-8cde-23797c266d51-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.614405 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.614408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blrbc\" (UniqueName: \"kubernetes.io/projected/30220f6d-2e4f-478c-8cde-23797c266d51-kube-api-access-blrbc\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.614604 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.614490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/30220f6d-2e4f-478c-8cde-23797c266d51-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.707218 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.707175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:27.715218 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.715181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/30220f6d-2e4f-478c-8cde-23797c266d51-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.715381 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.715270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30220f6d-2e4f-478c-8cde-23797c266d51-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.715381 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.715289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blrbc\" (UniqueName: \"kubernetes.io/projected/30220f6d-2e4f-478c-8cde-23797c266d51-kube-api-access-blrbc\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.715930 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.715909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/30220f6d-2e4f-478c-8cde-23797c266d51-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.717617 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.717598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/30220f6d-2e4f-478c-8cde-23797c266d51-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.723745 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.723718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blrbc\" (UniqueName: \"kubernetes.io/projected/30220f6d-2e4f-478c-8cde-23797c266d51-kube-api-access-blrbc\") pod \"kuadrant-console-plugin-fbdd4f445-shwbv\" (UID: \"30220f6d-2e4f-478c-8cde-23797c266d51\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:27.868598 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:27.868496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"
Sep 10 15:39:28.138272 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:28.138250    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv"]
Sep 10 15:39:28.140493 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:39:28.140468    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30220f6d_2e4f_478c_8cde_23797c266d51.slice/crio-76164a3bea7761033befdb77a27d8c9e8de46e98e4ff34db33e77d3a01693715 WatchSource:0}: Error finding container 76164a3bea7761033befdb77a27d8c9e8de46e98e4ff34db33e77d3a01693715: Status 404 returned error can't find the container with id 76164a3bea7761033befdb77a27d8c9e8de46e98e4ff34db33e77d3a01693715
Sep 10 15:39:28.812103 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:28.812068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv" event={"ID":"30220f6d-2e4f-478c-8cde-23797c266d51","Type":"ContainerStarted","Data":"76164a3bea7761033befdb77a27d8c9e8de46e98e4ff34db33e77d3a01693715"}
Sep 10 15:39:29.289612 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:29.289569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:29.839605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:29.839571    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:29.941973 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:29.941938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:33.229887 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:33.229850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:33.330625 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:33.330590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:34.200677 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:34.200638    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:34.300789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:34.300752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:34.401724 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:34.401689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:39.871696 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:39.871604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv" event={"ID":"30220f6d-2e4f-478c-8cde-23797c266d51","Type":"ContainerStarted","Data":"07aad6cf31f61a9ba81fe30b5ca5d8b8d13cb5b84c3ae271272c5fdb0e82d2e0"}
Sep 10 15:39:39.892031 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:39.891976    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-shwbv" podStartSLOduration=1.47063144 podStartE2EDuration="12.891946844s" totalImagesPullingTime="11.421315404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:39:39.890339184 +0000 UTC m=+456.705414927" watchObservedRunningTime="2026-09-10 15:39:39.891946844 +0000 UTC m=+456.707022584"
Sep 10 15:39:42.085068 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:42.085028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:42.183270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:42.183236    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:42.283901 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:42.283865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:42.383674 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:42.383588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:43.864551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:43.864512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:43.960892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:43.960864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:48.455725 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:48.455687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:48.558793 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:48.558763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:53.260130 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:53.260094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:53.361253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:53.361216    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:39:53.459347 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:39:53.459308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:01.287811 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:01.287775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:01.387199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:01.387167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:01.888425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:01.888374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:01.957879 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:01.957849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:04.886919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:04.886881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:04.973979 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:04.973938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:07.405849 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:07.405816    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:07.738542 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:07.738463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:09.485290 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:09.485253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:09.585635 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:09.585602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:13.271216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:13.271182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:13.365629 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:13.365593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:13.466633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:13.466594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:20.546111 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:20.546068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:20.649588 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:20.649548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:20.750457 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:20.750428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:20.971621 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:20.971591    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:40:20.993297 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:20.993266    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:40:20.993440 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:20.993369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:20.995814 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:20.995789    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 15:40:20.996551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:20.996528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:40:21.070683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.070639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74v84\" (UniqueName: \"kubernetes.io/projected/167d372c-3594-40ca-b622-11cccf2acbfb-kube-api-access-74v84\") pod \"limitador-limitador-84994f7ffc-8xwwp\" (UID: \"167d372c-3594-40ca-b622-11cccf2acbfb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:21.070683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.070689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/167d372c-3594-40ca-b622-11cccf2acbfb-config-file\") pod \"limitador-limitador-84994f7ffc-8xwwp\" (UID: \"167d372c-3594-40ca-b622-11cccf2acbfb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:21.171789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.171737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74v84\" (UniqueName: \"kubernetes.io/projected/167d372c-3594-40ca-b622-11cccf2acbfb-kube-api-access-74v84\") pod \"limitador-limitador-84994f7ffc-8xwwp\" (UID: \"167d372c-3594-40ca-b622-11cccf2acbfb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:21.172008 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.171803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/167d372c-3594-40ca-b622-11cccf2acbfb-config-file\") pod \"limitador-limitador-84994f7ffc-8xwwp\" (UID: \"167d372c-3594-40ca-b622-11cccf2acbfb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:21.172437 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.172416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/167d372c-3594-40ca-b622-11cccf2acbfb-config-file\") pod \"limitador-limitador-84994f7ffc-8xwwp\" (UID: \"167d372c-3594-40ca-b622-11cccf2acbfb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:21.181022 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.181003    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74v84\" (UniqueName: \"kubernetes.io/projected/167d372c-3594-40ca-b622-11cccf2acbfb-kube-api-access-74v84\") pod \"limitador-limitador-84994f7ffc-8xwwp\" (UID: \"167d372c-3594-40ca-b622-11cccf2acbfb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:21.303882 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.303787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:21.404263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.404229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:21.504405 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.504376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:21.574288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:21.574262    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:40:21.577048 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:40:21.577022    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167d372c_3594_40ca_b622_11cccf2acbfb.slice/crio-f122fee64ba117d8d88695ef26703d53d7ae0b117848b58437ed03fa675c2092 WatchSource:0}: Error finding container f122fee64ba117d8d88695ef26703d53d7ae0b117848b58437ed03fa675c2092: Status 404 returned error can't find the container with id f122fee64ba117d8d88695ef26703d53d7ae0b117848b58437ed03fa675c2092
Sep 10 15:40:22.064622 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:22.064577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp" event={"ID":"167d372c-3594-40ca-b622-11cccf2acbfb","Type":"ContainerStarted","Data":"f122fee64ba117d8d88695ef26703d53d7ae0b117848b58437ed03fa675c2092"}
Sep 10 15:40:24.077918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:24.077818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp" event={"ID":"167d372c-3594-40ca-b622-11cccf2acbfb","Type":"ContainerStarted","Data":"64db4fc32cf1f356fd770e59ba024b4934727aeca9ddc0d0bf11075b6829e9d6"}
Sep 10 15:40:24.077918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:24.077907    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:24.095606 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:24.095564    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp" podStartSLOduration=1.927603103 podStartE2EDuration="4.095549201s" totalImagesPullingTime="2.167946098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:40:24.093742225 +0000 UTC m=+500.908817977" watchObservedRunningTime="2026-09-10 15:40:24.095549201 +0000 UTC m=+500.910624940"
Sep 10 15:40:35.083450 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:35.083417    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"
Sep 10 15:40:40.826488 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:40.826446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:40.931798 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:40.931755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:41.350546 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:41.350506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:45.540185 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:45.540148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:45.600320 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:45.600289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:51.031207 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:51.031168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:53.531102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:53.531070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:40:53.729799 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:40:53.729767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:00.220745 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:00.220663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:00.321441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:00.321410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:00.421087 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:00.421055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:00.481191 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:00.481111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:00.618848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:00.618805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:03.632281 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:03.632248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:03.732874 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:03.732839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:38.424340 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:38.424306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:38.523528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:38.523495    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:39.810911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:39.810881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:39.911642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:39.911603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:40.013163 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:40.013123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:40.189536 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:40.189504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:40.380372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:40.380329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:40.480686 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:40.480592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:40.642539 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:40.642504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:41:47.344605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:47.344567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:47.448100 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:47.448063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:50.495707 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:50.495675    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:50.598484 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:50.598447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:56.364097 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:56.364055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:41:56.883590 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:41:56.883549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:42:01.766576 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:01.766538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:02.582443 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:02.582411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:03.343152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:03.343113    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:42:03.632559 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:03.632470    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:42:03.641497 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:03.641476    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:42:07.881201 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:07.881167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:08.955014 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:08.954976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:42:15.943523 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:15.943478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:17.055690 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:17.055652    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:42:31.156137 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.156045    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"]
Sep 10 15:42:31.159802 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.159770    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.163092 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.163067    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 15:42:31.163890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.163865    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 15:42:31.164738 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.164716    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ntw7b\""
Sep 10 15:42:31.165214 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.165195    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 15:42:31.174402 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.174365    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"]
Sep 10 15:42:31.174535 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.174501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.174604 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.174537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.174604 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.174592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.174719 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.174628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbfn\" (UniqueName: \"kubernetes.io/projected/57092d88-2640-4e1c-baea-63abd28699ab-kube-api-access-zkbfn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.174719 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.174665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.174719 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.174691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57092d88-2640-4e1c-baea-63abd28699ab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.198711 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.198674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:31.276077 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.276077 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.276313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.276313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbfn\" (UniqueName: \"kubernetes.io/projected/57092d88-2640-4e1c-baea-63abd28699ab-kube-api-access-zkbfn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.276313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.276313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57092d88-2640-4e1c-baea-63abd28699ab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.276539 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.276614 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.276651 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.276617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.278465 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.278438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57092d88-2640-4e1c-baea-63abd28699ab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.278705 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.278688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57092d88-2640-4e1c-baea-63abd28699ab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.284826 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.284803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbfn\" (UniqueName: \"kubernetes.io/projected/57092d88-2640-4e1c-baea-63abd28699ab-kube-api-access-zkbfn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9\" (UID: \"57092d88-2640-4e1c-baea-63abd28699ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.474864 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.474769    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:31.746094 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.746066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"]
Sep 10 15:42:31.748571 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:42:31.748543    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57092d88_2640_4e1c_baea_63abd28699ab.slice/crio-aeea5ff30ffecabd0ff87d56d2dc8e8c56a082a01fa37437eee273301628c749 WatchSource:0}: Error finding container aeea5ff30ffecabd0ff87d56d2dc8e8c56a082a01fa37437eee273301628c749: Status 404 returned error can't find the container with id aeea5ff30ffecabd0ff87d56d2dc8e8c56a082a01fa37437eee273301628c749
Sep 10 15:42:31.749774 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:31.749752    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:42:32.258592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:32.258509    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:42:32.682420 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:32.682385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9" event={"ID":"57092d88-2640-4e1c-baea-63abd28699ab","Type":"ContainerStarted","Data":"aeea5ff30ffecabd0ff87d56d2dc8e8c56a082a01fa37437eee273301628c749"}
Sep 10 15:42:33.689710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:33.689670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9" event={"ID":"57092d88-2640-4e1c-baea-63abd28699ab","Type":"ContainerStarted","Data":"0e4a8a99fe0353d69a24907a118d7b84f34019c0a9885ec5c126b8fd9057e3dc"}
Sep 10 15:42:33.708301 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:33.708248    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9" podStartSLOduration=1.687735121 podStartE2EDuration="2.708230356s" totalImagesPullingTime="1.020495235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:42:33.706868114 +0000 UTC m=+630.521943854" watchObservedRunningTime="2026-09-10 15:42:33.708230356 +0000 UTC m=+630.523306095"
Sep 10 15:42:41.475864 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:41.475802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:41.476303 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:41.475908    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:41.488678 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:41.488653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:41.741399 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:41.741313    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9"
Sep 10 15:42:56.678079 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:56.678042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:58.806709 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:58.806673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:59.118660 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:59.118565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:59.167818 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:59.167775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:42:59.348667 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:42:59.348635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:43:10.649781 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.649741    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"]
Sep 10 15:43:10.656309 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.656285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.658887 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.658863    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 10 15:43:10.664722 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.664699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"]
Sep 10 15:43:10.678204 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.678170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:43:10.832705 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.832672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.832917 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.832717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.832917 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.832746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.832917 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.832801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.832917 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.832821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhkks\" (UniqueName: \"kubernetes.io/projected/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-kube-api-access-zhkks\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.832917 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.832846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.933308 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.933270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.933558 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.933350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.933558 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.933507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhkks\" (UniqueName: \"kubernetes.io/projected/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-kube-api-access-zhkks\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.933685 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.933570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.933685 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.933624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.933685 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.933670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.933837 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.933778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.934008 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.933987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.934008 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.934001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.935669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.935650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.935932 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.935913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.942931 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.942909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhkks\" (UniqueName: \"kubernetes.io/projected/26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a-kube-api-access-zhkks\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr\" (UID: \"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:10.966553 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:10.966528    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:11.238066 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:11.238037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"]
Sep 10 15:43:11.240244 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:43:11.240220    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26537ff6_4cf4_4a0f_bfdf_ad3104d2b89a.slice/crio-98972cd10b91ecc3305c6ed6fb1d3c11ad8a3a58272d964c9ae6625a3f941b2e WatchSource:0}: Error finding container 98972cd10b91ecc3305c6ed6fb1d3c11ad8a3a58272d964c9ae6625a3f941b2e: Status 404 returned error can't find the container with id 98972cd10b91ecc3305c6ed6fb1d3c11ad8a3a58272d964c9ae6625a3f941b2e
Sep 10 15:43:11.876190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:11.876095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr" event={"ID":"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a","Type":"ContainerStarted","Data":"6b80c7f29084e14f82e174f91b168bb5e0cf61dfe1b79e124b26de271e794026"}
Sep 10 15:43:11.876190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:11.876138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr" event={"ID":"26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a","Type":"ContainerStarted","Data":"98972cd10b91ecc3305c6ed6fb1d3c11ad8a3a58272d964c9ae6625a3f941b2e"}
Sep 10 15:43:11.895857 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:11.895808    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr" podStartSLOduration=1.647612587 podStartE2EDuration="1.8957844s" totalImagesPullingTime="248.171813ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:43:11.893482096 +0000 UTC m=+668.708557838" watchObservedRunningTime="2026-09-10 15:43:11.8957844 +0000 UTC m=+668.710860139"
Sep 10 15:43:12.951558 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:12.951521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:43:20.967677 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:20.967644    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:20.968188 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:20.967697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:20.980116 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:20.980093    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:21.935939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:21.935900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr"
Sep 10 15:43:57.499805 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:57.499717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:43:57.552989 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:57.552924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:43:57.634870 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:57.634839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:43:57.698037 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:57.698006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:43:58.240164 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:58.240134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:43:58.292258 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:43:58.292231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:08.330306 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:08.330272    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7795797b5b-q84hq"]
Sep 10 15:44:08.464080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:08.464045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:08.564642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:08.564604    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:08.638343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:08.638249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:33.350167 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.350100    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7795797b5b-q84hq" podUID="74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" containerName="console" containerID="cri-o://9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e" gracePeriod=15
Sep 10 15:44:33.599785 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.599749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:44:33.664094 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664057    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-config\") pod \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") "
Sep 10 15:44:33.664263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664102    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-service-ca\") pod \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") "
Sep 10 15:44:33.664263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664126    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-trusted-ca-bundle\") pod \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") "
Sep 10 15:44:33.664263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-oauth-serving-cert\") pod \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") "
Sep 10 15:44:33.664263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664179    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-serving-cert\") pod \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") "
Sep 10 15:44:33.664263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664242    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t78n\" (UniqueName: \"kubernetes.io/projected/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-kube-api-access-8t78n\") pod \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") "
Sep 10 15:44:33.664495 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664381    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-oauth-config\") pod \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\" (UID: \"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00\") "
Sep 10 15:44:33.664568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664536    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-config" (OuterVolumeSpecName: "console-config") pod "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" (UID: "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:44:33.664623 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664582    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" (UID: "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:44:33.664623 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664587    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" (UID: "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:44:33.664718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664664    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-service-ca" (OuterVolumeSpecName: "service-ca") pod "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" (UID: "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:44:33.664804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664782    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-config\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:44:33.664804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664802    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:44:33.664980 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664815    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-trusted-ca-bundle\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:44:33.664980 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.664828    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-oauth-serving-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:44:33.666447 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.666419    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-kube-api-access-8t78n" (OuterVolumeSpecName: "kube-api-access-8t78n") pod "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" (UID: "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00"). InnerVolumeSpecName "kube-api-access-8t78n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:44:33.666552 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.666447    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" (UID: "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:44:33.666552 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.666498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" (UID: "74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:44:33.766317 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.766275    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-oauth-config\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:44:33.766317 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.766306    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-console-serving-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:44:33.766317 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:33.766318    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t78n\" (UniqueName: \"kubernetes.io/projected/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00-kube-api-access-8t78n\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:44:34.271664 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.271628    2565 generic.go:356] "Generic (PLEG): container finished" podID="74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" containerID="9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e" exitCode=0
Sep 10 15:44:34.271833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.271671    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7795797b5b-q84hq"
Sep 10 15:44:34.271833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.271686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7795797b5b-q84hq" event={"ID":"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00","Type":"ContainerDied","Data":"9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e"}
Sep 10 15:44:34.271833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.271727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7795797b5b-q84hq" event={"ID":"74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00","Type":"ContainerDied","Data":"42f7154201a181adb0e6ae864633e8ed475992afd103bf0eaf30f03ec2316b1c"}
Sep 10 15:44:34.271833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.271749    2565 scope.go:117] "RemoveContainer" containerID="9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e"
Sep 10 15:44:34.280301 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.280284    2565 scope.go:117] "RemoveContainer" containerID="9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e"
Sep 10 15:44:34.280574 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:44:34.280556    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e\": container with ID starting with 9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e not found: ID does not exist" containerID="9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e"
Sep 10 15:44:34.280619 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.280580    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e"} err="failed to get container status \"9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e\": rpc error: code = NotFound desc = could not find container \"9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e\": container with ID starting with 9049fbdb7e14be7119407886d1b666432e3a211701750338dfae75a12638ec9e not found: ID does not exist"
Sep 10 15:44:34.289043 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.289009    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7795797b5b-q84hq"]
Sep 10 15:44:34.294306 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:34.294283    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7795797b5b-q84hq"]
Sep 10 15:44:35.823476 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:35.823439    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" path="/var/lib/kubelet/pods/74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00/volumes"
Sep 10 15:44:37.985386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:37.985347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:38.084637 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:38.084607    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:39.133904 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:39.133866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:39.235015 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:39.234980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:54.646634 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:54.646588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:54.975765 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:54.975734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:55.075748 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:55.075709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:55.310815 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:55.310726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:56.034834 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.034799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:56.134229 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.134191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:56.558084 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.558051    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:44:56.558441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.558429    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" containerName="console"
Sep 10 15:44:56.558487 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.558443    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" containerName="console"
Sep 10 15:44:56.558522 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.558508    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="74fcc2cc-d2fc-4f2f-990e-fecbf8ba0e00" containerName="console"
Sep 10 15:44:56.562634 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.562613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:44:56.565185 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.565091    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tpk2l\""
Sep 10 15:44:56.566591 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.566569    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:44:56.669529 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.669498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbmss\" (UniqueName: \"kubernetes.io/projected/78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e-kube-api-access-wbmss\") pod \"test-curl-8186-140182329314736\" (UID: \"78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e\") " pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:44:56.709980 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.709923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:56.770978 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.770939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbmss\" (UniqueName: \"kubernetes.io/projected/78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e-kube-api-access-wbmss\") pod \"test-curl-8186-140182329314736\" (UID: \"78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e\") " pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:44:56.779325 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.779295    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbmss\" (UniqueName: \"kubernetes.io/projected/78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e-kube-api-access-wbmss\") pod \"test-curl-8186-140182329314736\" (UID: \"78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e\") " pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:44:56.872460 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:56.872347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:44:57.140178 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:57.140155    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:44:57.142350 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:44:57.142318    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78a0fa00_19dd_4448_9bb5_0f6dfe5dae4e.slice/crio-bc0763710eef8294e42243ab6d0c72ab0f6aa1dd339dad1a3b3a035662462fb5 WatchSource:0}: Error finding container bc0763710eef8294e42243ab6d0c72ab0f6aa1dd339dad1a3b3a035662462fb5: Status 404 returned error can't find the container with id bc0763710eef8294e42243ab6d0c72ab0f6aa1dd339dad1a3b3a035662462fb5
Sep 10 15:44:57.394499 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:57.394410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8186-140182329314736" event={"ID":"78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e","Type":"ContainerStarted","Data":"bc0763710eef8294e42243ab6d0c72ab0f6aa1dd339dad1a3b3a035662462fb5"}
Sep 10 15:44:58.469112 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:58.469074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:58.572308 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:58.572271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:59.404818 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:59.404783    2565 generic.go:356] "Generic (PLEG): container finished" podID="78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e" containerID="e121db1e31ac47474e11b156bbad92063203e6aec99ce65c89998877c2dc050c" exitCode=0
Sep 10 15:44:59.405031 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:59.404865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8186-140182329314736" event={"ID":"78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e","Type":"ContainerDied","Data":"e121db1e31ac47474e11b156bbad92063203e6aec99ce65c89998877c2dc050c"}
Sep 10 15:44:59.629647 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:59.629612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:44:59.731667 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:44:59.731570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:00.049527 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.049441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:00.137597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.137563    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"]
Sep 10 15:45:00.140820 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.140803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"
Sep 10 15:45:00.143256 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.143236    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vzj4n\""
Sep 10 15:45:00.151336 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.151309    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"]
Sep 10 15:45:00.152709 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.152686    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"
Sep 10 15:45:00.223216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.223178    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:00.326663 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.326566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:00.431109 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.431083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"]
Sep 10 15:45:00.433893 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:45:00.433865    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6297336c_94a7_41d7_af42_666780626dff.slice/crio-827f362b06be6daf579423ef7f5e7d53090fd056984adf8edf3e30c474e8e4e1 WatchSource:0}: Error finding container 827f362b06be6daf579423ef7f5e7d53090fd056984adf8edf3e30c474e8e4e1: Status 404 returned error can't find the container with id 827f362b06be6daf579423ef7f5e7d53090fd056984adf8edf3e30c474e8e4e1
Sep 10 15:45:00.547821 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.547799    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:00.571737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.571701    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8186-140182329314736_78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e/test-curl-8186-140182329314736/0.log"
Sep 10 15:45:00.593924 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.593844    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:45:00.596637 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.596604    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:45:00.609154 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.609133    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbmss\" (UniqueName: \"kubernetes.io/projected/78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e-kube-api-access-wbmss\") pod \"78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e\" (UID: \"78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e\") "
Sep 10 15:45:00.611248 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.611219    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e-kube-api-access-wbmss" (OuterVolumeSpecName: "kube-api-access-wbmss") pod "78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e" (UID: "78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e"). InnerVolumeSpecName "kube-api-access-wbmss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:45:00.652446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.652417    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:45:00.710436 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.710404    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbmss\" (UniqueName: \"kubernetes.io/projected/78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e-kube-api-access-wbmss\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:45:00.721909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.721880    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:45:00.722277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.722262    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e" containerName="test-curl-8186-140182329314736"
Sep 10 15:45:00.722330 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.722279    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e" containerName="test-curl-8186-140182329314736"
Sep 10 15:45:00.722370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.722348    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e" containerName="test-curl-8186-140182329314736"
Sep 10 15:45:00.725313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.725297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:00.731314 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.731288    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:45:00.811758 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.811721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxtz\" (UniqueName: \"kubernetes.io/projected/7820bcdf-2cef-4cbd-94c3-0004831cb9d5-kube-api-access-qwxtz\") pod \"test-curl-8186-140182329314736\" (UID: \"7820bcdf-2cef-4cbd-94c3-0004831cb9d5\") " pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:00.912907 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.912875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxtz\" (UniqueName: \"kubernetes.io/projected/7820bcdf-2cef-4cbd-94c3-0004831cb9d5-kube-api-access-qwxtz\") pod \"test-curl-8186-140182329314736\" (UID: \"7820bcdf-2cef-4cbd-94c3-0004831cb9d5\") " pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:00.920682 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:00.920650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxtz\" (UniqueName: \"kubernetes.io/projected/7820bcdf-2cef-4cbd-94c3-0004831cb9d5-kube-api-access-qwxtz\") pod \"test-curl-8186-140182329314736\" (UID: \"7820bcdf-2cef-4cbd-94c3-0004831cb9d5\") " pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:01.036807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:01.036773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:01.305640 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:01.305613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:45:01.308184 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:45:01.308153    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7820bcdf_2cef_4cbd_94c3_0004831cb9d5.slice/crio-739ccb2b8c881dbbcdf7101a36ee307763c62381d819c5c6be506793c4bbe0c4 WatchSource:0}: Error finding container 739ccb2b8c881dbbcdf7101a36ee307763c62381d819c5c6be506793c4bbe0c4: Status 404 returned error can't find the container with id 739ccb2b8c881dbbcdf7101a36ee307763c62381d819c5c6be506793c4bbe0c4
Sep 10 15:45:01.420340 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:01.420246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" event={"ID":"6297336c-94a7-41d7-af42-666780626dff","Type":"ContainerStarted","Data":"827f362b06be6daf579423ef7f5e7d53090fd056984adf8edf3e30c474e8e4e1"}
Sep 10 15:45:01.421711 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:01.421677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8186-140182329314736" event={"ID":"7820bcdf-2cef-4cbd-94c3-0004831cb9d5","Type":"ContainerStarted","Data":"739ccb2b8c881dbbcdf7101a36ee307763c62381d819c5c6be506793c4bbe0c4"}
Sep 10 15:45:01.423152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:01.423126    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:01.423292 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:01.423159    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc0763710eef8294e42243ab6d0c72ab0f6aa1dd339dad1a3b3a035662462fb5"
Sep 10 15:45:01.435288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:01.435255    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-8186-140182329314736" oldPodUID="78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e" podUID="7820bcdf-2cef-4cbd-94c3-0004831cb9d5"
Sep 10 15:45:01.828598 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:01.828510    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e" path="/var/lib/kubelet/pods/78a0fa00-19dd-4448-9bb5-0f6dfe5dae4e/volumes"
Sep 10 15:45:02.515175 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:02.515138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:02.697474 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:02.697439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:02.796633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:02.796592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:03.068981 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:03.068872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:03.173452 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:03.173418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:03.434835 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:03.434803    2565 generic.go:356] "Generic (PLEG): container finished" podID="6297336c-94a7-41d7-af42-666780626dff" containerID="d20b1255e1ac3d2edcfe302436cf9a1e425214e099373fbc3f5c76e75944c081" exitCode=7
Sep 10 15:45:03.435050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:03.434897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" event={"ID":"6297336c-94a7-41d7-af42-666780626dff","Type":"ContainerDied","Data":"d20b1255e1ac3d2edcfe302436cf9a1e425214e099373fbc3f5c76e75944c081"}
Sep 10 15:45:03.435113 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:03.435053    2565 scope.go:117] "RemoveContainer" containerID="d20b1255e1ac3d2edcfe302436cf9a1e425214e099373fbc3f5c76e75944c081"
Sep 10 15:45:03.436528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:03.436504    2565 generic.go:356] "Generic (PLEG): container finished" podID="7820bcdf-2cef-4cbd-94c3-0004831cb9d5" containerID="75f6d34d22dff8b54576fd0f4dd6a75d096741a731c9a35c7c973ddb20e332e6" exitCode=0
Sep 10 15:45:03.436635 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:03.436619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8186-140182329314736" event={"ID":"7820bcdf-2cef-4cbd-94c3-0004831cb9d5","Type":"ContainerDied","Data":"75f6d34d22dff8b54576fd0f4dd6a75d096741a731c9a35c7c973ddb20e332e6"}
Sep 10 15:45:04.443079 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.443044    2565 generic.go:356] "Generic (PLEG): container finished" podID="6297336c-94a7-41d7-af42-666780626dff" containerID="52678c86f87146dc81dd8eb1405a42e046059a3dfc3ab654d3ed0771c117bcdd" exitCode=7
Sep 10 15:45:04.443645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.443136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" event={"ID":"6297336c-94a7-41d7-af42-666780626dff","Type":"ContainerDied","Data":"52678c86f87146dc81dd8eb1405a42e046059a3dfc3ab654d3ed0771c117bcdd"}
Sep 10 15:45:04.443645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.443213    2565 scope.go:117] "RemoveContainer" containerID="d20b1255e1ac3d2edcfe302436cf9a1e425214e099373fbc3f5c76e75944c081"
Sep 10 15:45:04.443645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.443292    2565 scope.go:117] "RemoveContainer" containerID="52678c86f87146dc81dd8eb1405a42e046059a3dfc3ab654d3ed0771c117bcdd"
Sep 10 15:45:04.443645 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:45:04.443532    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv_odh-ai-gateway-infra(6297336c-94a7-41d7-af42-666780626dff)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" podUID="6297336c-94a7-41d7-af42-666780626dff"
Sep 10 15:45:04.576507 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.576475    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:04.595749 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.595719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8186-140182329314736_7820bcdf-2cef-4cbd-94c3-0004831cb9d5/test-curl-8186-140182329314736/0.log"
Sep 10 15:45:04.618348 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.618311    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:45:04.626484 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.626445    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8186-140182329314736"]
Sep 10 15:45:04.658635 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.658602    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwxtz\" (UniqueName: \"kubernetes.io/projected/7820bcdf-2cef-4cbd-94c3-0004831cb9d5-kube-api-access-qwxtz\") pod \"7820bcdf-2cef-4cbd-94c3-0004831cb9d5\" (UID: \"7820bcdf-2cef-4cbd-94c3-0004831cb9d5\") "
Sep 10 15:45:04.660720 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.660691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7820bcdf-2cef-4cbd-94c3-0004831cb9d5-kube-api-access-qwxtz" (OuterVolumeSpecName: "kube-api-access-qwxtz") pod "7820bcdf-2cef-4cbd-94c3-0004831cb9d5" (UID: "7820bcdf-2cef-4cbd-94c3-0004831cb9d5"). InnerVolumeSpecName "kube-api-access-qwxtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:45:04.743547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.743466    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8186-140182329314608"]
Sep 10 15:45:04.743892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.743877    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7820bcdf-2cef-4cbd-94c3-0004831cb9d5" containerName="test-curl-8186-140182329314736"
Sep 10 15:45:04.743941 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.743894    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7820bcdf-2cef-4cbd-94c3-0004831cb9d5" containerName="test-curl-8186-140182329314736"
Sep 10 15:45:04.744005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.743998    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7820bcdf-2cef-4cbd-94c3-0004831cb9d5" containerName="test-curl-8186-140182329314736"
Sep 10 15:45:04.746919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.746904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314608"
Sep 10 15:45:04.753789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.753764    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8186-140182329314608"]
Sep 10 15:45:04.760124 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.760098    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwxtz\" (UniqueName: \"kubernetes.io/projected/7820bcdf-2cef-4cbd-94c3-0004831cb9d5-kube-api-access-qwxtz\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:45:04.861407 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.861367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7rcx\" (UniqueName: \"kubernetes.io/projected/15c8026a-dba1-4dc4-835f-b07692d144b5-kube-api-access-v7rcx\") pod \"test-curl-8186-140182329314608\" (UID: \"15c8026a-dba1-4dc4-835f-b07692d144b5\") " pod="opendatahub/test-curl-8186-140182329314608"
Sep 10 15:45:04.962617 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.962574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7rcx\" (UniqueName: \"kubernetes.io/projected/15c8026a-dba1-4dc4-835f-b07692d144b5-kube-api-access-v7rcx\") pod \"test-curl-8186-140182329314608\" (UID: \"15c8026a-dba1-4dc4-835f-b07692d144b5\") " pod="opendatahub/test-curl-8186-140182329314608"
Sep 10 15:45:04.970286 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:04.970264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7rcx\" (UniqueName: \"kubernetes.io/projected/15c8026a-dba1-4dc4-835f-b07692d144b5-kube-api-access-v7rcx\") pod \"test-curl-8186-140182329314608\" (UID: \"15c8026a-dba1-4dc4-835f-b07692d144b5\") " pod="opendatahub/test-curl-8186-140182329314608"
Sep 10 15:45:05.057208 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:05.057126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314608"
Sep 10 15:45:05.325693 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:05.325668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8186-140182329314608"]
Sep 10 15:45:05.327481 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:45:05.327454    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15c8026a_dba1_4dc4_835f_b07692d144b5.slice/crio-fae18fd9b14afde7d45d4bd0fc0d18abf338e97b12a967c4ced25e577cf3c0d2 WatchSource:0}: Error finding container fae18fd9b14afde7d45d4bd0fc0d18abf338e97b12a967c4ced25e577cf3c0d2: Status 404 returned error can't find the container with id fae18fd9b14afde7d45d4bd0fc0d18abf338e97b12a967c4ced25e577cf3c0d2
Sep 10 15:45:05.449220 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:05.449182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8186-140182329314608" event={"ID":"15c8026a-dba1-4dc4-835f-b07692d144b5","Type":"ContainerStarted","Data":"fae18fd9b14afde7d45d4bd0fc0d18abf338e97b12a967c4ced25e577cf3c0d2"}
Sep 10 15:45:05.450929 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:05.450906    2565 scope.go:117] "RemoveContainer" containerID="52678c86f87146dc81dd8eb1405a42e046059a3dfc3ab654d3ed0771c117bcdd"
Sep 10 15:45:05.451229 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:45:05.451207    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv_odh-ai-gateway-infra(6297336c-94a7-41d7-af42-666780626dff)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" podUID="6297336c-94a7-41d7-af42-666780626dff"
Sep 10 15:45:05.452018 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:05.452000    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:05.452133 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:05.452003    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="739ccb2b8c881dbbcdf7101a36ee307763c62381d819c5c6be506793c4bbe0c4"
Sep 10 15:45:05.466916 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:45:05.466886    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8186-140182329314736\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="7820bcdf-2cef-4cbd-94c3-0004831cb9d5" pod="opendatahub/test-curl-8186-140182329314736"
Sep 10 15:45:05.824564 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:05.824512    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7820bcdf-2cef-4cbd-94c3-0004831cb9d5" path="/var/lib/kubelet/pods/7820bcdf-2cef-4cbd-94c3-0004831cb9d5/volumes"
Sep 10 15:45:06.093719 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:06.093627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:06.190137 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:06.190100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:06.458605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:06.458567    2565 generic.go:356] "Generic (PLEG): container finished" podID="15c8026a-dba1-4dc4-835f-b07692d144b5" containerID="0471149daa7735803a6cec758ba99f0ad5ae1bf3e43162659efb8fefb9e85ca4" exitCode=0
Sep 10 15:45:06.458988 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:06.458639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8186-140182329314608" event={"ID":"15c8026a-dba1-4dc4-835f-b07692d144b5","Type":"ContainerDied","Data":"0471149daa7735803a6cec758ba99f0ad5ae1bf3e43162659efb8fefb9e85ca4"}
Sep 10 15:45:07.284573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.284540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:07.384607 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.384563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:07.594631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.594604    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314608"
Sep 10 15:45:07.621468 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.621439    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8186-140182329314608_15c8026a-dba1-4dc4-835f-b07692d144b5/test-curl-8186-140182329314608/0.log"
Sep 10 15:45:07.647762 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.647732    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8186-140182329314608"]
Sep 10 15:45:07.661668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.661640    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8186-140182329314608"]
Sep 10 15:45:07.686169 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.686135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7rcx\" (UniqueName: \"kubernetes.io/projected/15c8026a-dba1-4dc4-835f-b07692d144b5-kube-api-access-v7rcx\") pod \"15c8026a-dba1-4dc4-835f-b07692d144b5\" (UID: \"15c8026a-dba1-4dc4-835f-b07692d144b5\") "
Sep 10 15:45:07.688205 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.688180    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15c8026a-dba1-4dc4-835f-b07692d144b5-kube-api-access-v7rcx" (OuterVolumeSpecName: "kube-api-access-v7rcx") pod "15c8026a-dba1-4dc4-835f-b07692d144b5" (UID: "15c8026a-dba1-4dc4-835f-b07692d144b5"). InnerVolumeSpecName "kube-api-access-v7rcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:45:07.787290 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.787247    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7rcx\" (UniqueName: \"kubernetes.io/projected/15c8026a-dba1-4dc4-835f-b07692d144b5-kube-api-access-v7rcx\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:45:07.824198 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.824124    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15c8026a-dba1-4dc4-835f-b07692d144b5" path="/var/lib/kubelet/pods/15c8026a-dba1-4dc4-835f-b07692d144b5/volumes"
Sep 10 15:45:07.828011 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.827988    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8186-140182326367408"]
Sep 10 15:45:07.828338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.828326    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c8026a-dba1-4dc4-835f-b07692d144b5" containerName="test-curl-8186-140182329314608"
Sep 10 15:45:07.828384 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.828339    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c8026a-dba1-4dc4-835f-b07692d144b5" containerName="test-curl-8186-140182329314608"
Sep 10 15:45:07.828436 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.828425    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="15c8026a-dba1-4dc4-835f-b07692d144b5" containerName="test-curl-8186-140182329314608"
Sep 10 15:45:07.831482 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.831457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182326367408"
Sep 10 15:45:07.831707 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.831685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:07.840688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.840667    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8186-140182326367408"]
Sep 10 15:45:07.887780 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.887749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgdph\" (UniqueName: \"kubernetes.io/projected/ae2922ee-8afb-4c29-b779-4acd82a4ad4a-kube-api-access-cgdph\") pod \"test-curl-8186-140182326367408\" (UID: \"ae2922ee-8afb-4c29-b779-4acd82a4ad4a\") " pod="opendatahub/test-curl-8186-140182326367408"
Sep 10 15:45:07.932259 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.932224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:07.989083 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:07.989048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgdph\" (UniqueName: \"kubernetes.io/projected/ae2922ee-8afb-4c29-b779-4acd82a4ad4a-kube-api-access-cgdph\") pod \"test-curl-8186-140182326367408\" (UID: \"ae2922ee-8afb-4c29-b779-4acd82a4ad4a\") " pod="opendatahub/test-curl-8186-140182326367408"
Sep 10 15:45:08.000521 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:08.000484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgdph\" (UniqueName: \"kubernetes.io/projected/ae2922ee-8afb-4c29-b779-4acd82a4ad4a-kube-api-access-cgdph\") pod \"test-curl-8186-140182326367408\" (UID: \"ae2922ee-8afb-4c29-b779-4acd82a4ad4a\") " pod="opendatahub/test-curl-8186-140182326367408"
Sep 10 15:45:08.142183 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:08.142096    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182326367408"
Sep 10 15:45:08.259716 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:08.259647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:08.415812 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:08.415781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8186-140182326367408"]
Sep 10 15:45:08.417974 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:45:08.417933    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae2922ee_8afb_4c29_b779_4acd82a4ad4a.slice/crio-07129fb268c0e287e03cddc4319d832608fc274c047f3a900a9b88d5d2d20ad7 WatchSource:0}: Error finding container 07129fb268c0e287e03cddc4319d832608fc274c047f3a900a9b88d5d2d20ad7: Status 404 returned error can't find the container with id 07129fb268c0e287e03cddc4319d832608fc274c047f3a900a9b88d5d2d20ad7
Sep 10 15:45:08.471410 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:08.471385    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182329314608"
Sep 10 15:45:08.471558 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:08.471423    2565 scope.go:117] "RemoveContainer" containerID="0471149daa7735803a6cec758ba99f0ad5ae1bf3e43162659efb8fefb9e85ca4"
Sep 10 15:45:08.472703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:08.472610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8186-140182326367408" event={"ID":"ae2922ee-8afb-4c29-b779-4acd82a4ad4a","Type":"ContainerStarted","Data":"07129fb268c0e287e03cddc4319d832608fc274c047f3a900a9b88d5d2d20ad7"}
Sep 10 15:45:09.480570 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:09.480536    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae2922ee-8afb-4c29-b779-4acd82a4ad4a" containerID="5c99ef6318098f4413b017b6d385baf13941c7c0676717b78e373027c46be123" exitCode=0
Sep 10 15:45:09.480954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:09.480620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8186-140182326367408" event={"ID":"ae2922ee-8afb-4c29-b779-4acd82a4ad4a","Type":"ContainerDied","Data":"5c99ef6318098f4413b017b6d385baf13941c7c0676717b78e373027c46be123"}
Sep 10 15:45:10.616243 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:10.616218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182326367408"
Sep 10 15:45:10.634156 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:10.634129    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8186-140182326367408_ae2922ee-8afb-4c29-b779-4acd82a4ad4a/test-curl-8186-140182326367408/0.log"
Sep 10 15:45:10.657556 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:10.657527    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8186-140182326367408"]
Sep 10 15:45:10.661091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:10.661067    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8186-140182326367408"]
Sep 10 15:45:10.712133 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:10.712103    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgdph\" (UniqueName: \"kubernetes.io/projected/ae2922ee-8afb-4c29-b779-4acd82a4ad4a-kube-api-access-cgdph\") pod \"ae2922ee-8afb-4c29-b779-4acd82a4ad4a\" (UID: \"ae2922ee-8afb-4c29-b779-4acd82a4ad4a\") "
Sep 10 15:45:10.714109 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:10.714086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae2922ee-8afb-4c29-b779-4acd82a4ad4a-kube-api-access-cgdph" (OuterVolumeSpecName: "kube-api-access-cgdph") pod "ae2922ee-8afb-4c29-b779-4acd82a4ad4a" (UID: "ae2922ee-8afb-4c29-b779-4acd82a4ad4a"). InnerVolumeSpecName "kube-api-access-cgdph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:45:10.813484 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:10.813391    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgdph\" (UniqueName: \"kubernetes.io/projected/ae2922ee-8afb-4c29-b779-4acd82a4ad4a-kube-api-access-cgdph\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:45:11.184593 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:11.184551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:11.491046 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:11.490901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:11.492893 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:11.492873    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8186-140182326367408"
Sep 10 15:45:11.493052 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:11.492875    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07129fb268c0e287e03cddc4319d832608fc274c047f3a900a9b88d5d2d20ad7"
Sep 10 15:45:11.502903 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:45:11.502870    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8186-140182326367408\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="ae2922ee-8afb-4c29-b779-4acd82a4ad4a" pod="opendatahub/test-curl-8186-140182326367408"
Sep 10 15:45:11.644927 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:11.644887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:11.823514 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:11.823432    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae2922ee-8afb-4c29-b779-4acd82a4ad4a" path="/var/lib/kubelet/pods/ae2922ee-8afb-4c29-b779-4acd82a4ad4a/volumes"
Sep 10 15:45:14.639735 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:14.639693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:14.725403 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:14.725366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:14.898644 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:14.898556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:45:15.743914 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.743880    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"]
Sep 10 15:45:15.744330 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.744309    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae2922ee-8afb-4c29-b779-4acd82a4ad4a" containerName="test-curl-8186-140182326367408"
Sep 10 15:45:15.744372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.744335    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae2922ee-8afb-4c29-b779-4acd82a4ad4a" containerName="test-curl-8186-140182326367408"
Sep 10 15:45:15.744472 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.744461    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae2922ee-8afb-4c29-b779-4acd82a4ad4a" containerName="test-curl-8186-140182326367408"
Sep 10 15:45:15.747798 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.747778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.751123 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.751100    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 15:45:15.752003 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.751982    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 15:45:15.752117 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.751983    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:45:15.752117 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.751986    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ql4pw\""
Sep 10 15:45:15.752288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.752269    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-d5048f-serving-cert\""
Sep 10 15:45:15.761660 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.761636    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"]
Sep 10 15:45:15.794663 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.794624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:15.851814 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.851781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:15.856602 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.856578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgrk4\" (UniqueName: \"kubernetes.io/projected/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-kube-api-access-rgrk4\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.856746 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.856634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.856746 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.856684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-openshift-service-ca\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.856746 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.856716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-metrics-certs\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.957753 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.957716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgrk4\" (UniqueName: \"kubernetes.io/projected/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-kube-api-access-rgrk4\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.957919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.957766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.957919 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:45:15.957854    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-serving-cert: secret "maas-api-e2e-autores-d5048f-serving-cert" not found
Sep 10 15:45:15.957919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.957885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-openshift-service-ca\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.957919 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:45:15.957902    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls podName:467ac6df-e82f-4e54-84ab-5f9f73e9bf81 nodeName:}" failed. No retries permitted until 2026-09-10 15:45:16.457887819 +0000 UTC m=+793.272963536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls") pod "maas-api-e2e-autores-d5048f-85bb8998d5-dk25s" (UID: "467ac6df-e82f-4e54-84ab-5f9f73e9bf81") : secret "maas-api-e2e-autores-d5048f-serving-cert" not found
Sep 10 15:45:15.958110 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.957927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-metrics-certs\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.958517 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.958492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-openshift-service-ca\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.960296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.960275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-metrics-certs\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:15.968866 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:15.968839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgrk4\" (UniqueName: \"kubernetes.io/projected/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-kube-api-access-rgrk4\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:16.047190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.047093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:16.147451 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.147420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:16.254671 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.254636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:16.348261 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.348172    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:16.452191 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.452161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:16.463249 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.463219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:16.465750 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.465723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls\") pod \"maas-api-e2e-autores-d5048f-85bb8998d5-dk25s\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:16.557015 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.556981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:16.661260 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.661225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:16.931715 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:16.931686    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"]
Sep 10 15:45:16.933342 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:45:16.933314    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467ac6df_e82f_4e54_84ab_5f9f73e9bf81.slice/crio-4bb3d9781a2391b332f9221b02eb062375b6a9339d36667d463acc439bb2ed7e WatchSource:0}: Error finding container 4bb3d9781a2391b332f9221b02eb062375b6a9339d36667d463acc439bb2ed7e: Status 404 returned error can't find the container with id 4bb3d9781a2391b332f9221b02eb062375b6a9339d36667d463acc439bb2ed7e
Sep 10 15:45:17.522590 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:17.522557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s" event={"ID":"467ac6df-e82f-4e54-84ab-5f9f73e9bf81","Type":"ContainerStarted","Data":"4bb3d9781a2391b332f9221b02eb062375b6a9339d36667d463acc439bb2ed7e"}
Sep 10 15:45:17.932007 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:17.931947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:18.031547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:18.031514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:18.148395 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:18.148336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:19.533746 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:19.533705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s" event={"ID":"467ac6df-e82f-4e54-84ab-5f9f73e9bf81","Type":"ContainerStarted","Data":"2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf"}
Sep 10 15:45:19.534264 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:19.533835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:19.553892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:19.553845    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s" podStartSLOduration=2.482306155 podStartE2EDuration="4.553831891s" totalImagesPullingTime="2.071525736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:45:19.551474839 +0000 UTC m=+796.366550579" watchObservedRunningTime="2026-09-10 15:45:19.553831891 +0000 UTC m=+796.368907630"
Sep 10 15:45:19.992512 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:19.992468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:20.708828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:20.708798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:20.817884 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:20.817844    2565 scope.go:117] "RemoveContainer" containerID="52678c86f87146dc81dd8eb1405a42e046059a3dfc3ab654d3ed0771c117bcdd"
Sep 10 15:45:21.546899 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:21.546863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" event={"ID":"6297336c-94a7-41d7-af42-666780626dff","Type":"ContainerStarted","Data":"1b135d8746161407ef6ae1af3c2be0f46ee812f5227a10d7a09682b558807af5"}
Sep 10 15:45:21.560329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:21.560269    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" podStartSLOduration=19.398850637 podStartE2EDuration="21.560248544s" totalImagesPullingTime="2.161397907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:45:21.559908849 +0000 UTC m=+798.374984591" watchObservedRunningTime="2026-09-10 15:45:21.560248544 +0000 UTC m=+798.375324347"
Sep 10 15:45:21.666353 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:21.666312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:21.767719 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:21.767685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:22.553719 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:22.553684    2565 generic.go:356] "Generic (PLEG): container finished" podID="6297336c-94a7-41d7-af42-666780626dff" containerID="1b135d8746161407ef6ae1af3c2be0f46ee812f5227a10d7a09682b558807af5" exitCode=0
Sep 10 15:45:22.553867 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:22.553757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" event={"ID":"6297336c-94a7-41d7-af42-666780626dff","Type":"ContainerDied","Data":"1b135d8746161407ef6ae1af3c2be0f46ee812f5227a10d7a09682b558807af5"}
Sep 10 15:45:22.553867 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:22.553815    2565 scope.go:117] "RemoveContainer" containerID="52678c86f87146dc81dd8eb1405a42e046059a3dfc3ab654d3ed0771c117bcdd"
Sep 10 15:45:22.577619 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:22.577591    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"]
Sep 10 15:45:23.468084 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:23.468054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:23.692418 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:23.692392    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"
Sep 10 15:45:23.842718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:23.842688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:24.145212 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.145135    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:24.343500 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.343468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:24.533210 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.533174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:24.565366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.565341    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"
Sep 10 15:45:24.565518 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.565366    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv" event={"ID":"6297336c-94a7-41d7-af42-666780626dff","Type":"ContainerDied","Data":"827f362b06be6daf579423ef7f5e7d53090fd056984adf8edf3e30c474e8e4e1"}
Sep 10 15:45:24.565518 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.565448    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="827f362b06be6daf579423ef7f5e7d53090fd056984adf8edf3e30c474e8e4e1"
Sep 10 15:45:24.596383 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.596356    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"]
Sep 10 15:45:24.602806 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.602780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:24.607140 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.607117    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-80d47c-29817585-2hcsv"]
Sep 10 15:45:24.721634 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:24.721600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:25.016257 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:25.016215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:25.545280 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:25.545253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:45:25.823560 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:25.823482    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6297336c-94a7-41d7-af42-666780626dff" path="/var/lib/kubelet/pods/6297336c-94a7-41d7-af42-666780626dff/volumes"
Sep 10 15:45:27.741382 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:27.741347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:27.840433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:27.840397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:29.116412 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.116378    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"]
Sep 10 15:45:29.116972 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.116937    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:29.117070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.116986    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:29.117070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.117009    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:29.117070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.117018    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:29.117070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.117042    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:29.117070 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.117050    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:29.117277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.117185    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:29.117277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.117199    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:29.120828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.120800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.123292 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.123268    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8a850d-serving-cert\""
Sep 10 15:45:29.127749 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.127728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"]
Sep 10 15:45:29.149763 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.149737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:29.250854 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.250822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:29.274535 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.274504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4956ef0-c540-47f0-b93f-b65deba2cb26-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.274644 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.274547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-metrics-certs\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.274682 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.274637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glt4w\" (UniqueName: \"kubernetes.io/projected/e4956ef0-c540-47f0-b93f-b65deba2cb26-kube-api-access-glt4w\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.274682 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.274671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.375693 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.375612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-metrics-certs\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.375847 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.375693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glt4w\" (UniqueName: \"kubernetes.io/projected/e4956ef0-c540-47f0-b93f-b65deba2cb26-kube-api-access-glt4w\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.375847 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.375724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.375847 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.375783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4956ef0-c540-47f0-b93f-b65deba2cb26-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.375998 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:45:29.375906    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-serving-cert: secret "maas-api-e2e-inf-b-8a850d-serving-cert" not found
Sep 10 15:45:29.376053 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:45:29.376006    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls podName:e4956ef0-c540-47f0-b93f-b65deba2cb26 nodeName:}" failed. No retries permitted until 2026-09-10 15:45:29.875984582 +0000 UTC m=+806.691060319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls") pod "maas-api-e2e-inf-b-8a850d-584997f68f-72tzv" (UID: "e4956ef0-c540-47f0-b93f-b65deba2cb26") : secret "maas-api-e2e-inf-b-8a850d-serving-cert" not found
Sep 10 15:45:29.376467 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.376450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4956ef0-c540-47f0-b93f-b65deba2cb26-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.378159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.378140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-metrics-certs\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.383677 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.383653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glt4w\" (UniqueName: \"kubernetes.io/projected/e4956ef0-c540-47f0-b93f-b65deba2cb26-kube-api-access-glt4w\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.657056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.657021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:29.759694 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.759666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:29.880496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.880464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:29.882993 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:29.882937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls\") pod \"maas-api-e2e-inf-b-8a850d-584997f68f-72tzv\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:30.033799 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.033716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:30.145941 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.145905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:30.304582 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.304551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"]
Sep 10 15:45:30.306239 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:45:30.306209    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4956ef0_c540_47f0_b93f_b65deba2cb26.slice/crio-3ee600756a4d4dda471267744bf20e4bd089f13ceaa548d091eef3a7e1aa43cb WatchSource:0}: Error finding container 3ee600756a4d4dda471267744bf20e4bd089f13ceaa548d091eef3a7e1aa43cb: Status 404 returned error can't find the container with id 3ee600756a4d4dda471267744bf20e4bd089f13ceaa548d091eef3a7e1aa43cb
Sep 10 15:45:30.596365 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.596288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv" event={"ID":"e4956ef0-c540-47f0-b93f-b65deba2cb26","Type":"ContainerStarted","Data":"3ee600756a4d4dda471267744bf20e4bd089f13ceaa548d091eef3a7e1aa43cb"}
Sep 10 15:45:30.628738 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.628704    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"]
Sep 10 15:45:30.629202 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.629186    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6297336c-94a7-41d7-af42-666780626dff" containerName="cleanup"
Sep 10 15:45:30.633426 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.633406    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.635722 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.635701    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-bebc8cbc-kserve-self-signed-certs\""
Sep 10 15:45:30.640732 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.640711    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"]
Sep 10 15:45:30.787928 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.787898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-home\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.788054 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.787983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-dshm\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.788054 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.788031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-model-cache\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.788146 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.788052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-tmp-dir\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.788146 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.788077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plhmz\" (UniqueName: \"kubernetes.io/projected/cbd1e305-d4da-4801-a5d5-9be071b5e107-kube-api-access-plhmz\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.788216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.788142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbd1e305-d4da-4801-a5d5-9be071b5e107-tls-certs\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.845511 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.845480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:45:30.854821 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.854739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:30.888848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.888820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-home\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.889005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.888878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-dshm\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.889005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.888915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-model-cache\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.889005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.888931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-tmp-dir\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.889005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.888951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plhmz\" (UniqueName: \"kubernetes.io/projected/cbd1e305-d4da-4801-a5d5-9be071b5e107-kube-api-access-plhmz\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.889219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.889015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbd1e305-d4da-4801-a5d5-9be071b5e107-tls-certs\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.889336 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.889290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-home\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.889380 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.889340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-model-cache\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.889380 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.889366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-tmp-dir\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.891285 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.891265    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-dshm\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.891539 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.891522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbd1e305-d4da-4801-a5d5-9be071b5e107-tls-certs\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.896895 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.896877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plhmz\" (UniqueName: \"kubernetes.io/projected/cbd1e305-d4da-4801-a5d5-9be071b5e107-kube-api-access-plhmz\") pod \"e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") " pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:30.944880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:30.944852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:31.021307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.018862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:31.218053 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.218028    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"]
Sep 10 15:45:31.220101 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:45:31.220061    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbd1e305_d4da_4801_a5d5_9be071b5e107.slice/crio-2c5435c524a6610529eb865f6563f263f6b6ded9e91a050103ecb00adecbfcf6 WatchSource:0}: Error finding container 2c5435c524a6610529eb865f6563f263f6b6ded9e91a050103ecb00adecbfcf6: Status 404 returned error can't find the container with id 2c5435c524a6610529eb865f6563f263f6b6ded9e91a050103ecb00adecbfcf6
Sep 10 15:45:31.603642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.603551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv" event={"ID":"e4956ef0-c540-47f0-b93f-b65deba2cb26","Type":"ContainerStarted","Data":"7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604"}
Sep 10 15:45:31.603806 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.603641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:31.605138 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.605115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p" event={"ID":"cbd1e305-d4da-4801-a5d5-9be071b5e107","Type":"ContainerStarted","Data":"d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7"}
Sep 10 15:45:31.605251 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.605144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p" event={"ID":"cbd1e305-d4da-4801-a5d5-9be071b5e107","Type":"ContainerStarted","Data":"2c5435c524a6610529eb865f6563f263f6b6ded9e91a050103ecb00adecbfcf6"}
Sep 10 15:45:31.621456 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.621410    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv" podStartSLOduration=2.225061903 podStartE2EDuration="2.621397297s" totalImagesPullingTime="396.335394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:45:31.619550921 +0000 UTC m=+808.434626662" watchObservedRunningTime="2026-09-10 15:45:31.621397297 +0000 UTC m=+808.436473037"
Sep 10 15:45:31.636600 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.636553    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p" podStartSLOduration=1.636539374 podStartE2EDuration="1.636539374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:45:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:45:31.634844848 +0000 UTC m=+808.449920588" watchObservedRunningTime="2026-09-10 15:45:31.636539374 +0000 UTC m=+808.451615113"
Sep 10 15:45:31.782563 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.782532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:31.884625 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.884549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:31.984567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:31.984540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:37.515263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:37.515228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:37.615953 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:37.615924    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:45:38.458906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:38.458871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:39.541973 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:39.541928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:39.642287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:39.642249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:40.945055 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:40.944947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:40.945055 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:40.945020    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:40.957747 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:40.957720    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:41.667690 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:41.667654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:45:46.249179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:46.249143    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:45:47.700068 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:47.700026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:48.265658 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:48.265623    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:48.365770 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:48.365731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:48.467319 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:48.467284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:48.523459 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:48.523368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:48.624239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:48.624204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:49.105710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.105671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:49.199861 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.199828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:49.297608 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.297574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:49.579213 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.579180    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"]
Sep 10 15:45:49.590053 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.590026    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.593724 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.593695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"]
Sep 10 15:45:49.593919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.593758    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d8392afe-gw-openshift-default-dockercfg-mjjzz\""
Sep 10 15:45:49.594096 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.594075    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 15:45:49.615418 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.615385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:49.660810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.660770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-envoy\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.660810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.660811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istiod-ca-cert\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.661060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.660867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-token\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.661060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.660889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-podinfo\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.661060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.660909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-data\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.661060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.660927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thtvv\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-kube-api-access-thtvv\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.661060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.660992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-credential-socket\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.661222 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.661075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-socket\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.661222 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.661103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-certs\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.724869 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.724833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:49.761942 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.761906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-envoy\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.761942 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.761947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istiod-ca-cert\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762192 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-token\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762192 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-podinfo\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762192 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-data\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762192 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thtvv\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-kube-api-access-thtvv\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-credential-socket\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-socket\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-certs\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762575 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-data\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762720 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-credential-socket\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762720 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-certs\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762856 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762816    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istiod-ca-cert\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.762856 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.762817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-socket\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.764351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.764324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-envoy\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.764582 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.764564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-podinfo\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.770119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.770093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-token\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.770289 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.770269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thtvv\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-kube-api-access-thtvv\") pod \"e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") " pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:49.901890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:49.901854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:50.095897 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:50.095852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:50.183504 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:50.183481    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"]
Sep 10 15:45:50.185839 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:45:50.185810    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61e76bd_164d_4dde_af86_bd5ac02b0b93.slice/crio-e7544b3cf4a288e825a8f4d459dd4beb28e089c3a36759b0958141e4d82de219 WatchSource:0}: Error finding container e7544b3cf4a288e825a8f4d459dd4beb28e089c3a36759b0958141e4d82de219: Status 404 returned error can't find the container with id e7544b3cf4a288e825a8f4d459dd4beb28e089c3a36759b0958141e4d82de219
Sep 10 15:45:50.702198 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:50.702163    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" event={"ID":"a61e76bd-164d-4dde-af86-bd5ac02b0b93","Type":"ContainerStarted","Data":"e7544b3cf4a288e825a8f4d459dd4beb28e089c3a36759b0958141e4d82de219"}
Sep 10 15:45:52.724153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:52.724087    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:52.975907 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:52.975851    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:45:52.975999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:52.975983    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:45:52.976056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:52.976029    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:45:53.721845 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:53.721807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" event={"ID":"a61e76bd-164d-4dde-af86-bd5ac02b0b93","Type":"ContainerStarted","Data":"25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912"}
Sep 10 15:45:53.762487 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:53.762426    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" podStartSLOduration=1.975472394 podStartE2EDuration="4.762409296s" totalImagesPullingTime="2.786936902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:45:53.759515912 +0000 UTC m=+830.574591678" watchObservedRunningTime="2026-09-10 15:45:53.762409296 +0000 UTC m=+830.577485112"
Sep 10 15:45:53.902742 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:53.902703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:54.907743 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:54.907710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:55.302319 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:55.302234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:55.402197 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:55.402164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:55.636230 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:55.636144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:55.731730 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:55.731700    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:55.732795 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:55.732775    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:45:55.738836 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:55.738807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:55.836020 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:55.835976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:56.126779 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:56.126741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:45:56.199332 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:45:56.199299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:01.647545 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:01.647509    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:46:11.773107 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:11.773069    2565 patch_prober.go:28] interesting pod/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:46:11.775389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:11.773137    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:46:12.822331 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:12.822299    2565 generic.go:356] "Generic (PLEG): container finished" podID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerID="25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912" exitCode=0
Sep 10 15:46:12.822697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:12.822372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" event={"ID":"a61e76bd-164d-4dde-af86-bd5ac02b0b93","Type":"ContainerDied","Data":"25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912"}
Sep 10 15:46:12.822741 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:12.822725    2565 scope.go:117] "RemoveContainer" containerID="25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912"
Sep 10 15:46:12.823792 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:12.823761    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:46:12.823912 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:12.823842    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:46:12.823912 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:12.823900    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:46:13.828743 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:13.828707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" event={"ID":"a61e76bd-164d-4dde-af86-bd5ac02b0b93","Type":"ContainerStarted","Data":"bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1"}
Sep 10 15:46:13.902392 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:13.902355    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:46:13.902572 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:13.902551    2565 patch_prober.go:28] interesting pod/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 10 15:46:13.902617 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:13.902597    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 10 15:46:14.902807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:14.902774    2565 patch_prober.go:28] interesting pod/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 10 15:46:14.903213 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:14.902828    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 10 15:46:15.902995 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:15.902939    2565 patch_prober.go:28] interesting pod/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 10 15:46:15.903384 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:15.903047    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 10 15:46:16.902777 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:16.902742    2565 patch_prober.go:28] interesting pod/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 10 15:46:16.902980 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:16.902804    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 10 15:46:17.052941 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:17.052896    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:46:17.902384 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:17.902349    2565 patch_prober.go:28] interesting pod/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 10 15:46:17.902573 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:17.902405    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 10 15:46:18.936488 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:18.936453    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:46:18.936956 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:18.936839    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:46:18.937638 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:18.937621    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:46:25.939592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.939559    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"]
Sep 10 15:46:25.948172 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.948150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:25.950757 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.950737    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-bebc8cbc-kserve-self-signed-certs\""
Sep 10 15:46:25.954975 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.954114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"]
Sep 10 15:46:25.996971 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.996937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-model-cache\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:25.997103 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.996994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-tmp-dir\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:25.997103 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.997014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-home\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:25.997103 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.997046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-dshm\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:25.997103 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.997065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7fec440-b70f-4528-8727-e5dbe159da24-tls-certs\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:25.997244 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:25.997173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrfxv\" (UniqueName: \"kubernetes.io/projected/d7fec440-b70f-4528-8727-e5dbe159da24-kube-api-access-nrfxv\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.048216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.048184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:26.098139 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-home\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.098288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-dshm\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.098348 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7fec440-b70f-4528-8727-e5dbe159da24-tls-certs\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.098430 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrfxv\" (UniqueName: \"kubernetes.io/projected/d7fec440-b70f-4528-8727-e5dbe159da24-kube-api-access-nrfxv\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.098490 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-model-cache\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.098550 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-tmp-dir\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.098605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-home\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.098786 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-tmp-dir\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.098863 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.098847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-model-cache\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.100510 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.100490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-dshm\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.100771 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.100752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7fec440-b70f-4528-8727-e5dbe159da24-tls-certs\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.105706 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.105683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrfxv\" (UniqueName: \"kubernetes.io/projected/d7fec440-b70f-4528-8727-e5dbe159da24-kube-api-access-nrfxv\") pod \"e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") " pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.261652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.261572    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:26.450666 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.450633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:26.533691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.533662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"]
Sep 10 15:46:26.535516 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:46:26.535487    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7fec440_b70f_4528_8727_e5dbe159da24.slice/crio-3053bbe482c8419e08e6ffc077983e5823573e8bdc3fe48bfd1a2c662ce63ce6 WatchSource:0}: Error finding container 3053bbe482c8419e08e6ffc077983e5823573e8bdc3fe48bfd1a2c662ce63ce6: Status 404 returned error can't find the container with id 3053bbe482c8419e08e6ffc077983e5823573e8bdc3fe48bfd1a2c662ce63ce6
Sep 10 15:46:26.871306 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.871223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:26.904447 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.904416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h" event={"ID":"d7fec440-b70f-4528-8727-e5dbe159da24","Type":"ContainerStarted","Data":"d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767"}
Sep 10 15:46:26.904632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.904493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h" event={"ID":"d7fec440-b70f-4528-8727-e5dbe159da24","Type":"ContainerStarted","Data":"3053bbe482c8419e08e6ffc077983e5823573e8bdc3fe48bfd1a2c662ce63ce6"}
Sep 10 15:46:26.923948 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.923831    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h" podStartSLOduration=1.923811232 podStartE2EDuration="1.923811232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:46:26.923328547 +0000 UTC m=+863.738404319" watchObservedRunningTime="2026-09-10 15:46:26.923811232 +0000 UTC m=+863.738886975"
Sep 10 15:46:26.972068 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:26.972018    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:27.197527 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:27.197496    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"]
Sep 10 15:46:27.197829 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:27.197740    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy" containerID="cri-o://bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1" gracePeriod=30
Sep 10 15:46:27.945319 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:27.945264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:28.043388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:28.043331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:28.112071 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:28.112039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:30.617700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:30.617662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:30.709646 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:30.709605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:31.771746 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:31.771710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:31.872678 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:31.872632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:31.933519 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:31.933487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:32.246821 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.246792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:32.326041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.326004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:32.450488 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.450457    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:46:32.560591 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560525    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-data\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.560591 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560568    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-token\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.560803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-envoy\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.560803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-certs\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.560803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istiod-ca-cert\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.560803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560734    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-socket\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.560803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-podinfo\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.560803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560784    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-credential-socket\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.560803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560794    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-data" (OuterVolumeSpecName: "istio-data") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:46:32.561206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.560818    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thtvv\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-kube-api-access-thtvv\") pod \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\" (UID: \"a61e76bd-164d-4dde-af86-bd5ac02b0b93\") "
Sep 10 15:46:32.561206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.561064    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:46:32.561206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.561081    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:46:32.561206 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.561092    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:46:32.561422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.561207    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.561422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.561227    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.561422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.561242    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.561422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.561286    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.561633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.561419    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:46:32.563041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.563005    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:46:32.563041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.563031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:46:32.563190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.563107    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-token" (OuterVolumeSpecName: "istio-token") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:46:32.563190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.563146    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-kube-api-access-thtvv" (OuterVolumeSpecName: "kube-api-access-thtvv") pod "a61e76bd-164d-4dde-af86-bd5ac02b0b93" (UID: "a61e76bd-164d-4dde-af86-bd5ac02b0b93"). InnerVolumeSpecName "kube-api-access-thtvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:46:32.661892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.661867    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.661892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.661888    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.662066 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.661897    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.662066 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.661907    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61e76bd-164d-4dde-af86-bd5ac02b0b93-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.662066 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.661915    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thtvv\" (UniqueName: \"kubernetes.io/projected/a61e76bd-164d-4dde-af86-bd5ac02b0b93-kube-api-access-thtvv\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:46:32.936948 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.936913    2565 generic.go:356] "Generic (PLEG): container finished" podID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerID="bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1" exitCode=0
Sep 10 15:46:32.937425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.936994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"
Sep 10 15:46:32.937425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.936993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" event={"ID":"a61e76bd-164d-4dde-af86-bd5ac02b0b93","Type":"ContainerDied","Data":"bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1"}
Sep 10 15:46:32.937425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.937111    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw" event={"ID":"a61e76bd-164d-4dde-af86-bd5ac02b0b93","Type":"ContainerDied","Data":"e7544b3cf4a288e825a8f4d459dd4beb28e089c3a36759b0958141e4d82de219"}
Sep 10 15:46:32.937425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.937134    2565 scope.go:117] "RemoveContainer" containerID="bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1"
Sep 10 15:46:32.949257 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.949207    2565 scope.go:117] "RemoveContainer" containerID="25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912"
Sep 10 15:46:32.958184 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.958166    2565 scope.go:117] "RemoveContainer" containerID="bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1"
Sep 10 15:46:32.958832 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:46:32.958515    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1\": container with ID starting with bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1 not found: ID does not exist" containerID="bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1"
Sep 10 15:46:32.958832 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.958550    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1"} err="failed to get container status \"bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1\": rpc error: code = NotFound desc = could not find container \"bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1\": container with ID starting with bd8211bfef957249c0a4ee072a8a4fd56a2de9a5780bbe50f0d80146252555c1 not found: ID does not exist"
Sep 10 15:46:32.958832 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.958573    2565 scope.go:117] "RemoveContainer" containerID="25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912"
Sep 10 15:46:32.959072 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:46:32.958874    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912\": container with ID starting with 25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912 not found: ID does not exist" containerID="25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912"
Sep 10 15:46:32.959072 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.958895    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912"} err="failed to get container status \"25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912\": rpc error: code = NotFound desc = could not find container \"25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912\": container with ID starting with 25fcefcd7f1cdecf5491ce2ddf4e9340fce14261857adca5ac815dc5e5924912 not found: ID does not exist"
Sep 10 15:46:32.959910 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.959867    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"]
Sep 10 15:46:32.965557 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:32.965535    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d8392afe-gw-openshift-default-6cf688477b-qqfxw"]
Sep 10 15:46:33.825570 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:33.825535    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" path="/var/lib/kubelet/pods/a61e76bd-164d-4dde-af86-bd5ac02b0b93/volumes"
Sep 10 15:46:34.761491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:34.761453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:46:36.262090 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:36.262051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:36.262577 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:36.262106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:36.274445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:36.274418    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:36.969105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:36.969076    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:46:49.441834 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.441797    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"]
Sep 10 15:46:49.442270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.442225    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy"
Sep 10 15:46:49.442270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.442238    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy"
Sep 10 15:46:49.442270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.442258    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy"
Sep 10 15:46:49.442270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.442264    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy"
Sep 10 15:46:49.442405 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.442346    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy"
Sep 10 15:46:49.442405 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.442360    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a61e76bd-164d-4dde-af86-bd5ac02b0b93" containerName="istio-proxy"
Sep 10 15:46:49.446994 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.446974    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.449412 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.449390    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-d5048f\"/\"kube-root-ca.crt\""
Sep 10 15:46:49.450185 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.450163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-d5048f\"/\"openshift-service-ca.crt\""
Sep 10 15:46:49.450268 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.450198    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-d5048f\"/\"default-dockercfg-bfc48\""
Sep 10 15:46:49.450268 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.450219    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-d5048f\"/\"autores-model-d5048f-kserve-self-signed-certs\""
Sep 10 15:46:49.456597 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.456576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"]
Sep 10 15:46:49.468419 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.468394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:46:49.514652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.514625    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-tmp-dir\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.514756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.514658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm8jp\" (UniqueName: \"kubernetes.io/projected/65707362-1fa6-4963-911a-32751b1713ad-kube-api-access-mm8jp\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.514756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.514680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-model-cache\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.514756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.514738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65707362-1fa6-4963-911a-32751b1713ad-tls-certs\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.514895 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.514812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-home\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.514937 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.514910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-dshm\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616293 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-dshm\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616403 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-tmp-dir\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616403 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm8jp\" (UniqueName: \"kubernetes.io/projected/65707362-1fa6-4963-911a-32751b1713ad-kube-api-access-mm8jp\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616517 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-model-cache\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616517 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65707362-1fa6-4963-911a-32751b1713ad-tls-certs\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616634 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-home\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616690 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616677    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-tmp-dir\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616787 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-model-cache\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.616908 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.616890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-home\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.618489 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.618466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-dshm\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.618871 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.618854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65707362-1fa6-4963-911a-32751b1713ad-tls-certs\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.623838 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.623818    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm8jp\" (UniqueName: \"kubernetes.io/projected/65707362-1fa6-4963-911a-32751b1713ad-kube-api-access-mm8jp\") pod \"autores-model-d5048f-kserve-79d7bff84c-frhgv\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") " pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:49.757042 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:49.756981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:50.026221 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:50.026197    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"]
Sep 10 15:46:50.028368 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:46:50.028341    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65707362_1fa6_4963_911a_32751b1713ad.slice/crio-512d90aaada9a3cbcfa74ea75c68fe5f1b085b41c2a21325cbf85761e1dca4e3 WatchSource:0}: Error finding container 512d90aaada9a3cbcfa74ea75c68fe5f1b085b41c2a21325cbf85761e1dca4e3: Status 404 returned error can't find the container with id 512d90aaada9a3cbcfa74ea75c68fe5f1b085b41c2a21325cbf85761e1dca4e3
Sep 10 15:46:51.028286 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:51.028250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv" event={"ID":"65707362-1fa6-4963-911a-32751b1713ad","Type":"ContainerStarted","Data":"6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8"}
Sep 10 15:46:51.028702 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:51.028292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv" event={"ID":"65707362-1fa6-4963-911a-32751b1713ad","Type":"ContainerStarted","Data":"512d90aaada9a3cbcfa74ea75c68fe5f1b085b41c2a21325cbf85761e1dca4e3"}
Sep 10 15:46:51.046645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:51.046599    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv" podStartSLOduration=2.046585431 podStartE2EDuration="2.046585431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:46:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:46:51.044560122 +0000 UTC m=+887.859635865" watchObservedRunningTime="2026-09-10 15:46:51.046585431 +0000 UTC m=+887.861661211"
Sep 10 15:46:51.743424 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:51.743389    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:46:59.757452 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:59.757363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:59.757452 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:59.757420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:46:59.769566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:46:59.769545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:47:00.083845 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:00.083759    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:47:02.002148 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:02.002109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:02.638333 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:02.638301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:02.739360 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:02.739331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:02.838868 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:02.838822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:02.941784 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:02.941751    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:03.674804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:03.674772    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:47:03.680896 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:03.680874    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:47:03.979492 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:03.979401    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:04.411845 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:04.411797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:04.709327 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:04.709237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:04.991474 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:04.991378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:06.758828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:06.758794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:06.860814 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:06.860774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:06.981781 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:06.981738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:07.744314 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:07.744275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:47:07.996395 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:07.996306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:08.059729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:08.059692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:08.188001 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:08.187951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:08.453776 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:08.453741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:08.554073 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:08.554039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:23.581433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:23.581394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:24.371516 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:24.371483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:47:27.445442 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:27.445404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:28.967530 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:28.967498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:33.220087 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:33.220044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:33.806454 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:33.806418    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"]
Sep 10 15:47:33.806676 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:33.806630    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s" podUID="467ac6df-e82f-4e54-84ab-5f9f73e9bf81" containerName="maas-api" containerID="cri-o://2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf" gracePeriod=30
Sep 10 15:47:33.830257 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:33.830228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:34.055026 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.055002    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:47:34.227870 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.227842    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-openshift-service-ca\") pod \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") "
Sep 10 15:47:34.228341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.227908    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgrk4\" (UniqueName: \"kubernetes.io/projected/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-kube-api-access-rgrk4\") pod \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") "
Sep 10 15:47:34.228341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.227951    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-metrics-certs\") pod \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") "
Sep 10 15:47:34.228341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.228108    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls\") pod \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\" (UID: \"467ac6df-e82f-4e54-84ab-5f9f73e9bf81\") "
Sep 10 15:47:34.228341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.228273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "467ac6df-e82f-4e54-84ab-5f9f73e9bf81" (UID: "467ac6df-e82f-4e54-84ab-5f9f73e9bf81"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:47:34.228537 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.228515    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-openshift-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:34.230265 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.230235    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "467ac6df-e82f-4e54-84ab-5f9f73e9bf81" (UID: "467ac6df-e82f-4e54-84ab-5f9f73e9bf81"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:47:34.230265 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.230253    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "467ac6df-e82f-4e54-84ab-5f9f73e9bf81" (UID: "467ac6df-e82f-4e54-84ab-5f9f73e9bf81"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:47:34.230456 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.230290    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-kube-api-access-rgrk4" (OuterVolumeSpecName: "kube-api-access-rgrk4") pod "467ac6df-e82f-4e54-84ab-5f9f73e9bf81" (UID: "467ac6df-e82f-4e54-84ab-5f9f73e9bf81"). InnerVolumeSpecName "kube-api-access-rgrk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:47:34.244208 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.244179    2565 generic.go:356] "Generic (PLEG): container finished" podID="467ac6df-e82f-4e54-84ab-5f9f73e9bf81" containerID="2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf" exitCode=0
Sep 10 15:47:34.244309 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.244228    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"
Sep 10 15:47:34.244309 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.244248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s" event={"ID":"467ac6df-e82f-4e54-84ab-5f9f73e9bf81","Type":"ContainerDied","Data":"2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf"}
Sep 10 15:47:34.244309 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.244301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s" event={"ID":"467ac6df-e82f-4e54-84ab-5f9f73e9bf81","Type":"ContainerDied","Data":"4bb3d9781a2391b332f9221b02eb062375b6a9339d36667d463acc439bb2ed7e"}
Sep 10 15:47:34.244422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.244331    2565 scope.go:117] "RemoveContainer" containerID="2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf"
Sep 10 15:47:34.253147 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.253126    2565 scope.go:117] "RemoveContainer" containerID="2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf"
Sep 10 15:47:34.253402 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:47:34.253383    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf\": container with ID starting with 2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf not found: ID does not exist" containerID="2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf"
Sep 10 15:47:34.253468 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.253415    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf"} err="failed to get container status \"2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf\": rpc error: code = NotFound desc = could not find container \"2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf\": container with ID starting with 2c2ef027822c2083724eb73cfd555ff767d6d6f69d1f7bfb4a8324fba67ed9bf not found: ID does not exist"
Sep 10 15:47:34.265149 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.265124    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"]
Sep 10 15:47:34.266809 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.266790    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-d5048f-85bb8998d5-dk25s"]
Sep 10 15:47:34.329629 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.329605    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-maas-api-tls\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:34.329629 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.329627    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgrk4\" (UniqueName: \"kubernetes.io/projected/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-kube-api-access-rgrk4\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:34.329745 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.329636    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/467ac6df-e82f-4e54-84ab-5f9f73e9bf81-metrics-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:34.733462 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.733430    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:34.834440 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:34.834400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:35.824095 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:35.824065    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="467ac6df-e82f-4e54-84ab-5f9f73e9bf81" path="/var/lib/kubelet/pods/467ac6df-e82f-4e54-84ab-5f9f73e9bf81/volumes"
Sep 10 15:47:38.277663 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:38.277629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:38.910094 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:38.910049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:39.023233 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:39.023203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:39.124010 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:39.123976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:39.185488 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:39.185400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:39.329930 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:39.329896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:39.365396 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:39.365369    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"]
Sep 10 15:47:39.412915 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:39.412872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:39.997669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:39.997636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:40.096448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:40.096412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:40.199664 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:40.199632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:40.252859 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:40.252780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:47:41.629688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:41.629647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:42.330123 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:42.330088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:45.644890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:45.644855    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"]
Sep 10 15:47:45.662838 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:45.662803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:46.369326 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:46.369289    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"]
Sep 10 15:47:46.389737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:46.389681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:47.073296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:47.073262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:47.837109 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:47.837079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:47.904882 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:47.904851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:47.984921 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:47.984890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:48.084807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:48.084778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:48.521639 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:48.521589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:47:54.384924 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.384885    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv" podUID="65707362-1fa6-4963-911a-32751b1713ad" containerName="main" containerID="cri-o://6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8" gracePeriod=45
Sep 10 15:47:54.546271 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.546240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:47:54.634718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.634696    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:47:54.702923 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.702891    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm8jp\" (UniqueName: \"kubernetes.io/projected/65707362-1fa6-4963-911a-32751b1713ad-kube-api-access-mm8jp\") pod \"65707362-1fa6-4963-911a-32751b1713ad\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") "
Sep 10 15:47:54.703126 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.702945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-tmp-dir\") pod \"65707362-1fa6-4963-911a-32751b1713ad\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") "
Sep 10 15:47:54.703200 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-dshm\") pod \"65707362-1fa6-4963-911a-32751b1713ad\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") "
Sep 10 15:47:54.703258 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-home\") pod \"65707362-1fa6-4963-911a-32751b1713ad\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") "
Sep 10 15:47:54.703258 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703215    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65707362-1fa6-4963-911a-32751b1713ad" (UID: "65707362-1fa6-4963-911a-32751b1713ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:47:54.703258 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-model-cache\") pod \"65707362-1fa6-4963-911a-32751b1713ad\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") "
Sep 10 15:47:54.703422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65707362-1fa6-4963-911a-32751b1713ad-tls-certs\") pod \"65707362-1fa6-4963-911a-32751b1713ad\" (UID: \"65707362-1fa6-4963-911a-32751b1713ad\") "
Sep 10 15:47:54.703422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703413    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-home" (OuterVolumeSpecName: "home") pod "65707362-1fa6-4963-911a-32751b1713ad" (UID: "65707362-1fa6-4963-911a-32751b1713ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:47:54.703536 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703512    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "65707362-1fa6-4963-911a-32751b1713ad" (UID: "65707362-1fa6-4963-911a-32751b1713ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:47:54.703645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703627    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:54.703700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703649    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:54.703700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.703662    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:54.705157 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.705128    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-dshm" (OuterVolumeSpecName: "dshm") pod "65707362-1fa6-4963-911a-32751b1713ad" (UID: "65707362-1fa6-4963-911a-32751b1713ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:47:54.705298 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.705278    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65707362-1fa6-4963-911a-32751b1713ad-kube-api-access-mm8jp" (OuterVolumeSpecName: "kube-api-access-mm8jp") pod "65707362-1fa6-4963-911a-32751b1713ad" (UID: "65707362-1fa6-4963-911a-32751b1713ad"). InnerVolumeSpecName "kube-api-access-mm8jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:47:54.705298 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.705287    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65707362-1fa6-4963-911a-32751b1713ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65707362-1fa6-4963-911a-32751b1713ad" (UID: "65707362-1fa6-4963-911a-32751b1713ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:47:54.804125 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.804101    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65707362-1fa6-4963-911a-32751b1713ad-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:54.804125 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.804125    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm8jp\" (UniqueName: \"kubernetes.io/projected/65707362-1fa6-4963-911a-32751b1713ad-kube-api-access-mm8jp\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:54.804278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:54.804135    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65707362-1fa6-4963-911a-32751b1713ad-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:47:55.362088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.362053    2565 generic.go:356] "Generic (PLEG): container finished" podID="65707362-1fa6-4963-911a-32751b1713ad" containerID="6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8" exitCode=0
Sep 10 15:47:55.362295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.362104    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"
Sep 10 15:47:55.362295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.362145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv" event={"ID":"65707362-1fa6-4963-911a-32751b1713ad","Type":"ContainerDied","Data":"6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8"}
Sep 10 15:47:55.362295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.362198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv" event={"ID":"65707362-1fa6-4963-911a-32751b1713ad","Type":"ContainerDied","Data":"512d90aaada9a3cbcfa74ea75c68fe5f1b085b41c2a21325cbf85761e1dca4e3"}
Sep 10 15:47:55.362295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.362221    2565 scope.go:117] "RemoveContainer" containerID="6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8"
Sep 10 15:47:55.371666 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.371649    2565 scope.go:117] "RemoveContainer" containerID="6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8"
Sep 10 15:47:55.371993 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:47:55.371952    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8\": container with ID starting with 6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8 not found: ID does not exist" containerID="6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8"
Sep 10 15:47:55.372052 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.372004    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8"} err="failed to get container status \"6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8\": rpc error: code = NotFound desc = could not find container \"6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8\": container with ID starting with 6b89485148d73e33b9fcfdb7331f9cbda9b82cc210745ed80d97df73693d55c8 not found: ID does not exist"
Sep 10 15:47:55.383056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.383033    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"]
Sep 10 15:47:55.386052 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.386030    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-d5048f/autores-model-d5048f-kserve-79d7bff84c-frhgv"]
Sep 10 15:47:55.824222 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:47:55.824191    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65707362-1fa6-4963-911a-32751b1713ad" path="/var/lib/kubelet/pods/65707362-1fa6-4963-911a-32751b1713ad/volumes"
Sep 10 15:48:00.665219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.665175    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p" podUID="cbd1e305-d4da-4801-a5d5-9be071b5e107" containerName="main" containerID="cri-o://d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7" gracePeriod=45
Sep 10 15:48:00.905188 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.905167    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:48:00.960173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960080    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-model-cache\") pod \"cbd1e305-d4da-4801-a5d5-9be071b5e107\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") "
Sep 10 15:48:00.960317 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960172    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-dshm\") pod \"cbd1e305-d4da-4801-a5d5-9be071b5e107\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") "
Sep 10 15:48:00.960317 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960230    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbd1e305-d4da-4801-a5d5-9be071b5e107-tls-certs\") pod \"cbd1e305-d4da-4801-a5d5-9be071b5e107\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") "
Sep 10 15:48:00.960429 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960358    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-tmp-dir\") pod \"cbd1e305-d4da-4801-a5d5-9be071b5e107\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") "
Sep 10 15:48:00.960429 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960403    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plhmz\" (UniqueName: \"kubernetes.io/projected/cbd1e305-d4da-4801-a5d5-9be071b5e107-kube-api-access-plhmz\") pod \"cbd1e305-d4da-4801-a5d5-9be071b5e107\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") "
Sep 10 15:48:00.960528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960436    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-model-cache" (OuterVolumeSpecName: "model-cache") pod "cbd1e305-d4da-4801-a5d5-9be071b5e107" (UID: "cbd1e305-d4da-4801-a5d5-9be071b5e107"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:48:00.960528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960464    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-home\") pod \"cbd1e305-d4da-4801-a5d5-9be071b5e107\" (UID: \"cbd1e305-d4da-4801-a5d5-9be071b5e107\") "
Sep 10 15:48:00.960671 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960639    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cbd1e305-d4da-4801-a5d5-9be071b5e107" (UID: "cbd1e305-d4da-4801-a5d5-9be071b5e107"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:48:00.960781 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960753    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:00.960906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960776    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-home" (OuterVolumeSpecName: "home") pod "cbd1e305-d4da-4801-a5d5-9be071b5e107" (UID: "cbd1e305-d4da-4801-a5d5-9be071b5e107"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:48:00.960906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.960786    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:00.962527 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.962503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-dshm" (OuterVolumeSpecName: "dshm") pod "cbd1e305-d4da-4801-a5d5-9be071b5e107" (UID: "cbd1e305-d4da-4801-a5d5-9be071b5e107"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:48:00.962628 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.962543    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd1e305-d4da-4801-a5d5-9be071b5e107-kube-api-access-plhmz" (OuterVolumeSpecName: "kube-api-access-plhmz") pod "cbd1e305-d4da-4801-a5d5-9be071b5e107" (UID: "cbd1e305-d4da-4801-a5d5-9be071b5e107"). InnerVolumeSpecName "kube-api-access-plhmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:48:00.962628 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:00.962590    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd1e305-d4da-4801-a5d5-9be071b5e107-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cbd1e305-d4da-4801-a5d5-9be071b5e107" (UID: "cbd1e305-d4da-4801-a5d5-9be071b5e107"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:48:01.061389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.061361    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plhmz\" (UniqueName: \"kubernetes.io/projected/cbd1e305-d4da-4801-a5d5-9be071b5e107-kube-api-access-plhmz\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.061389 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.061386    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.061539 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.061401    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbd1e305-d4da-4801-a5d5-9be071b5e107-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.061539 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.061412    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbd1e305-d4da-4801-a5d5-9be071b5e107-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.388831 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.388721    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h" podUID="d7fec440-b70f-4528-8727-e5dbe159da24" containerName="main" containerID="cri-o://d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767" gracePeriod=45
Sep 10 15:48:01.394100 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.394074    2565 generic.go:356] "Generic (PLEG): container finished" podID="cbd1e305-d4da-4801-a5d5-9be071b5e107" containerID="d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7" exitCode=0
Sep 10 15:48:01.394228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.394138    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"
Sep 10 15:48:01.394228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.394157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p" event={"ID":"cbd1e305-d4da-4801-a5d5-9be071b5e107","Type":"ContainerDied","Data":"d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7"}
Sep 10 15:48:01.394228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.394202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p" event={"ID":"cbd1e305-d4da-4801-a5d5-9be071b5e107","Type":"ContainerDied","Data":"2c5435c524a6610529eb865f6563f263f6b6ded9e91a050103ecb00adecbfcf6"}
Sep 10 15:48:01.394228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.394225    2565 scope.go:117] "RemoveContainer" containerID="d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7"
Sep 10 15:48:01.452397 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.452381    2565 scope.go:117] "RemoveContainer" containerID="d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7"
Sep 10 15:48:01.452660 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:01.452644    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7\": container with ID starting with d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7 not found: ID does not exist" containerID="d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7"
Sep 10 15:48:01.452712 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.452667    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7"} err="failed to get container status \"d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7\": rpc error: code = NotFound desc = could not find container \"d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7\": container with ID starting with d2c4834894b8bc579285e19a02fe35df148d033d09a06af708a63f158ec0e3a7 not found: ID does not exist"
Sep 10 15:48:01.463145 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.463118    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"]
Sep 10 15:48:01.468131 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.468112    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-bebc8cbc-kserve-7d54dbd7c-7jp2p"]
Sep 10 15:48:01.637365 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.637343    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:48:01.767471 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767442    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-tmp-dir\") pod \"d7fec440-b70f-4528-8727-e5dbe159da24\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") "
Sep 10 15:48:01.767810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767496    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-home\") pod \"d7fec440-b70f-4528-8727-e5dbe159da24\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") "
Sep 10 15:48:01.767810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767534    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-model-cache\") pod \"d7fec440-b70f-4528-8727-e5dbe159da24\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") "
Sep 10 15:48:01.767810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767579    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7fec440-b70f-4528-8727-e5dbe159da24-tls-certs\") pod \"d7fec440-b70f-4528-8727-e5dbe159da24\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") "
Sep 10 15:48:01.767810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767606    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrfxv\" (UniqueName: \"kubernetes.io/projected/d7fec440-b70f-4528-8727-e5dbe159da24-kube-api-access-nrfxv\") pod \"d7fec440-b70f-4528-8727-e5dbe159da24\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") "
Sep 10 15:48:01.767810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767635    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-dshm\") pod \"d7fec440-b70f-4528-8727-e5dbe159da24\" (UID: \"d7fec440-b70f-4528-8727-e5dbe159da24\") "
Sep 10 15:48:01.767810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767735    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d7fec440-b70f-4528-8727-e5dbe159da24" (UID: "d7fec440-b70f-4528-8727-e5dbe159da24"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:48:01.767810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767769    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-model-cache" (OuterVolumeSpecName: "model-cache") pod "d7fec440-b70f-4528-8727-e5dbe159da24" (UID: "d7fec440-b70f-4528-8727-e5dbe159da24"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:48:01.767810 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767793    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-home" (OuterVolumeSpecName: "home") pod "d7fec440-b70f-4528-8727-e5dbe159da24" (UID: "d7fec440-b70f-4528-8727-e5dbe159da24"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:48:01.768216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767928    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.768216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767946    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.768216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.767981    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.769783 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.769756    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-dshm" (OuterVolumeSpecName: "dshm") pod "d7fec440-b70f-4528-8727-e5dbe159da24" (UID: "d7fec440-b70f-4528-8727-e5dbe159da24"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:48:01.769881 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.769817    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7fec440-b70f-4528-8727-e5dbe159da24-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d7fec440-b70f-4528-8727-e5dbe159da24" (UID: "d7fec440-b70f-4528-8727-e5dbe159da24"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:48:01.769881 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.769843    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7fec440-b70f-4528-8727-e5dbe159da24-kube-api-access-nrfxv" (OuterVolumeSpecName: "kube-api-access-nrfxv") pod "d7fec440-b70f-4528-8727-e5dbe159da24" (UID: "d7fec440-b70f-4528-8727-e5dbe159da24"). InnerVolumeSpecName "kube-api-access-nrfxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:48:01.823682 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.823657    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbd1e305-d4da-4801-a5d5-9be071b5e107" path="/var/lib/kubelet/pods/cbd1e305-d4da-4801-a5d5-9be071b5e107/volumes"
Sep 10 15:48:01.868723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.868701    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7fec440-b70f-4528-8727-e5dbe159da24-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.868723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.868722    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrfxv\" (UniqueName: \"kubernetes.io/projected/d7fec440-b70f-4528-8727-e5dbe159da24-kube-api-access-nrfxv\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:01.868849 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:01.868733    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7fec440-b70f-4528-8727-e5dbe159da24-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:48:02.400514 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.400475    2565 generic.go:356] "Generic (PLEG): container finished" podID="d7fec440-b70f-4528-8727-e5dbe159da24" containerID="d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767" exitCode=0
Sep 10 15:48:02.400700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.400522    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"
Sep 10 15:48:02.400700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.400556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h" event={"ID":"d7fec440-b70f-4528-8727-e5dbe159da24","Type":"ContainerDied","Data":"d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767"}
Sep 10 15:48:02.400700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.400594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h" event={"ID":"d7fec440-b70f-4528-8727-e5dbe159da24","Type":"ContainerDied","Data":"3053bbe482c8419e08e6ffc077983e5823573e8bdc3fe48bfd1a2c662ce63ce6"}
Sep 10 15:48:02.400700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.400615    2565 scope.go:117] "RemoveContainer" containerID="d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767"
Sep 10 15:48:02.408932 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.408918    2565 scope.go:117] "RemoveContainer" containerID="d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767"
Sep 10 15:48:02.409224 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:02.409206    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767\": container with ID starting with d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767 not found: ID does not exist" containerID="d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767"
Sep 10 15:48:02.409285 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.409233    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767"} err="failed to get container status \"d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767\": rpc error: code = NotFound desc = could not find container \"d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767\": container with ID starting with d17e74b69520733f88d474e79e98478ef23c2f0977fbc6999af94af216e62767 not found: ID does not exist"
Sep 10 15:48:02.417478 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.417429    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"]
Sep 10 15:48:02.419416 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:02.419398    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-bebc8cbc-kserve-cf67f9dbc-8m44h"]
Sep 10 15:48:03.823693 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:03.823666    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7fec440-b70f-4528-8727-e5dbe159da24" path="/var/lib/kubelet/pods/d7fec440-b70f-4528-8727-e5dbe159da24/volumes"
Sep 10 15:48:09.645219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:09.645177    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:48:14.463425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:14.463387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:16.383091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:16.383050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:16.490190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:16.490162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:16.931685 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:16.931649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:17.215145 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215066    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"]
Sep 10 15:48:17.215436 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215424    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467ac6df-e82f-4e54-84ab-5f9f73e9bf81" containerName="maas-api"
Sep 10 15:48:17.215481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215437    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="467ac6df-e82f-4e54-84ab-5f9f73e9bf81" containerName="maas-api"
Sep 10 15:48:17.215481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215446    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd1e305-d4da-4801-a5d5-9be071b5e107" containerName="main"
Sep 10 15:48:17.215481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215452    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd1e305-d4da-4801-a5d5-9be071b5e107" containerName="main"
Sep 10 15:48:17.215481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215459    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7fec440-b70f-4528-8727-e5dbe159da24" containerName="main"
Sep 10 15:48:17.215481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215466    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7fec440-b70f-4528-8727-e5dbe159da24" containerName="main"
Sep 10 15:48:17.215481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215476    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65707362-1fa6-4963-911a-32751b1713ad" containerName="main"
Sep 10 15:48:17.215481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215481    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="65707362-1fa6-4963-911a-32751b1713ad" containerName="main"
Sep 10 15:48:17.215714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215563    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="65707362-1fa6-4963-911a-32751b1713ad" containerName="main"
Sep 10 15:48:17.215714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215574    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="467ac6df-e82f-4e54-84ab-5f9f73e9bf81" containerName="maas-api"
Sep 10 15:48:17.215714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215581    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd1e305-d4da-4801-a5d5-9be071b5e107" containerName="main"
Sep 10 15:48:17.215714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.215589    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7fec440-b70f-4528-8727-e5dbe159da24" containerName="main"
Sep 10 15:48:17.220404 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.220383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.222765 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.222741    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 15:48:17.222891 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.222866    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-76a9b8-openshift-default-dockercfg-bzsls\""
Sep 10 15:48:17.230804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.230780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"]
Sep 10 15:48:17.244337 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.244312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:17.305352 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istiod-ca-cert\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.305473 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2czr\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-kube-api-access-n2czr\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.305473 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-envoy\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.305473 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-token\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.305579 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-podinfo\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.305579 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-data\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.305643 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-socket\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.305643 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-certs\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.305708 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.305656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-credential-socket\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.406656 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.406623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-envoy\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.406656 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.406656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-token\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.406677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-podinfo\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.406814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-data\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.406871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-socket\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.406900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-certs\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.406936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-credential-socket\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.407031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istiod-ca-cert\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.407069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2czr\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-kube-api-access-n2czr\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407456 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.407194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-data\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407456 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.407286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-certs\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407456 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.407344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-credential-socket\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407456 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.407435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-socket\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.407737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.407715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istiod-ca-cert\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.408921 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.408902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-envoy\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.409325 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.409304    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-podinfo\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.414348 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.414323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-token\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.414428 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.414363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2czr\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-kube-api-access-n2czr\") pod \"e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") " pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.484387 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.484305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:17.532557 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.532525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:17.805666 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.805641    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"]
Sep 10 15:48:17.808040 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:48:17.808011    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba58f5eb_31a6_45d1_9fdd_db0b457cc0c3.slice/crio-4be098ba78596d304a84076ba1134d0ff634fbcf4e351000dd00233baaa0e66c WatchSource:0}: Error finding container 4be098ba78596d304a84076ba1134d0ff634fbcf4e351000dd00233baaa0e66c: Status 404 returned error can't find the container with id 4be098ba78596d304a84076ba1134d0ff634fbcf4e351000dd00233baaa0e66c
Sep 10 15:48:17.810143 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.810105    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:48:17.810242 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.810174    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:48:17.810242 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:17.810203    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:48:18.493914 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:18.493882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" event={"ID":"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3","Type":"ContainerStarted","Data":"4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee"}
Sep 10 15:48:18.494314 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:18.493932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" event={"ID":"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3","Type":"ContainerStarted","Data":"4be098ba78596d304a84076ba1134d0ff634fbcf4e351000dd00233baaa0e66c"}
Sep 10 15:48:18.516361 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:18.516317    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" podStartSLOduration=1.5163027850000002 podStartE2EDuration="1.516302785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:48:18.514172144 +0000 UTC m=+975.329247884" watchObservedRunningTime="2026-09-10 15:48:18.516302785 +0000 UTC m=+975.331378522"
Sep 10 15:48:18.532844 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:18.532819    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:18.537658 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:18.537636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:19.499448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:19.499412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:19.500298 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:19.500278    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:20.272313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:20.272275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:20.372603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:20.372560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:20.472470 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:20.472432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:21.479067 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.479035    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"]
Sep 10 15:48:21.483287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.483266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.485821 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.485800    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-76a9b8-serving-cert\""
Sep 10 15:48:21.497925 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.497903    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"]
Sep 10 15:48:21.516905 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.516874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:21.573715 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.573684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:21.643853 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.643819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztk66\" (UniqueName: \"kubernetes.io/projected/0afbd5f6-8431-4ff3-a747-b34d3dd38954-kube-api-access-ztk66\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.644058 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.643878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0afbd5f6-8431-4ff3-a747-b34d3dd38954-openshift-service-ca\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.644058 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.643896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-metrics-certs\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.644058 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.643925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.744982 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.744895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0afbd5f6-8431-4ff3-a747-b34d3dd38954-openshift-service-ca\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.744982 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.744923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-metrics-certs\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.744982 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.744948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.745175 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.745024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztk66\" (UniqueName: \"kubernetes.io/projected/0afbd5f6-8431-4ff3-a747-b34d3dd38954-kube-api-access-ztk66\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.745175 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:21.745158    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-serving-cert: secret "maas-api-e2e-explicit-76a9b8-serving-cert" not found
Sep 10 15:48:21.745278 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:21.745265    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls podName:0afbd5f6-8431-4ff3-a747-b34d3dd38954 nodeName:}" failed. No retries permitted until 2026-09-10 15:48:22.245242431 +0000 UTC m=+979.060318164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls") pod "maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z" (UID: "0afbd5f6-8431-4ff3-a747-b34d3dd38954") : secret "maas-api-e2e-explicit-76a9b8-serving-cert" not found
Sep 10 15:48:21.745591 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.745564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0afbd5f6-8431-4ff3-a747-b34d3dd38954-openshift-service-ca\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.747429 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.747409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-metrics-certs\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.753748 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.753720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztk66\" (UniqueName: \"kubernetes.io/projected/0afbd5f6-8431-4ff3-a747-b34d3dd38954-kube-api-access-ztk66\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:21.814001 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:21.813947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:22.104331 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:22.104255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:22.201217 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:22.201181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:22.250353 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:22.250320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:22.252692 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:22.252660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls\") pod \"maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:22.395021 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:22.394917    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:22.665267 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:22.665241    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"]
Sep 10 15:48:22.667611 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:48:22.667586    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afbd5f6_8431_4ff3_a747_b34d3dd38954.slice/crio-578c5bbd3b6c9299236ba931900d7f2932cbeae4a3c21383eee2982be9a66af2 WatchSource:0}: Error finding container 578c5bbd3b6c9299236ba931900d7f2932cbeae4a3c21383eee2982be9a66af2: Status 404 returned error can't find the container with id 578c5bbd3b6c9299236ba931900d7f2932cbeae4a3c21383eee2982be9a66af2
Sep 10 15:48:22.669029 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:22.669012    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:48:23.521881 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:23.521843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z" event={"ID":"0afbd5f6-8431-4ff3-a747-b34d3dd38954","Type":"ContainerStarted","Data":"1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52"}
Sep 10 15:48:23.522038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:23.521925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z" event={"ID":"0afbd5f6-8431-4ff3-a747-b34d3dd38954","Type":"ContainerStarted","Data":"578c5bbd3b6c9299236ba931900d7f2932cbeae4a3c21383eee2982be9a66af2"}
Sep 10 15:48:23.522038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:23.521949    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:23.538452 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:23.538402    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z" podStartSLOduration=1.797884504 podStartE2EDuration="2.538387303s" totalImagesPullingTime="740.502799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:48:23.536627839 +0000 UTC m=+980.351703579" watchObservedRunningTime="2026-09-10 15:48:23.538387303 +0000 UTC m=+980.353463044"
Sep 10 15:48:24.650661 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:24.650629    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:48:29.533091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:29.533013    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:48:36.263343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:36.263295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:38.241623 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.241589    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"]
Sep 10 15:48:38.245282 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.245260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.248804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.248782    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8a850d\"/\"default-dockercfg-56jpv\""
Sep 10 15:48:38.248931 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.248799    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8a850d\"/\"openshift-service-ca.crt\""
Sep 10 15:48:38.248931 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.248845    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8a850d\"/\"kube-root-ca.crt\""
Sep 10 15:48:38.248931 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.248792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8a850d\"/\"test-model-8a850d-kserve-self-signed-certs\""
Sep 10 15:48:38.255208 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.255185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"]
Sep 10 15:48:38.272071 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.272036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:38.295009 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.294988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-dshm\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.295121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.295014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tls-certs\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.295121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.295049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt76h\" (UniqueName: \"kubernetes.io/projected/b89ec0eb-0870-4e42-8f29-df961cf44d5d-kube-api-access-dt76h\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.295121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.295099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-home\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.295244 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.295122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-model-cache\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.295244 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.295194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tmp-dir\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.396497 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.396467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt76h\" (UniqueName: \"kubernetes.io/projected/b89ec0eb-0870-4e42-8f29-df961cf44d5d-kube-api-access-dt76h\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.396633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.396507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-home\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.396633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.396530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-model-cache\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.396633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.396562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tmp-dir\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.396633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.396596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-dshm\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.396633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.396611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tls-certs\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.396915 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.396898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-home\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.397023 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.397001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-model-cache\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.397023 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.397012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tmp-dir\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.398909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.398886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-dshm\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.399195 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.399177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tls-certs\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.404292 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.404270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt76h\" (UniqueName: \"kubernetes.io/projected/b89ec0eb-0870-4e42-8f29-df961cf44d5d-kube-api-access-dt76h\") pod \"test-model-8a850d-kserve-67b9696f65-x7qhn\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") " pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.554864 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.554797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:38.740154 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.740118    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:48:38.827729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:38.827702    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"]
Sep 10 15:48:38.829214 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:48:38.829190    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb89ec0eb_0870_4e42_8f29_df961cf44d5d.slice/crio-39ef6af5d3d57abb77aec3b58b6fb1ccb9cf595b4172605019181ac037169ef0 WatchSource:0}: Error finding container 39ef6af5d3d57abb77aec3b58b6fb1ccb9cf595b4172605019181ac037169ef0: Status 404 returned error can't find the container with id 39ef6af5d3d57abb77aec3b58b6fb1ccb9cf595b4172605019181ac037169ef0
Sep 10 15:48:39.607152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:39.607113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn" event={"ID":"b89ec0eb-0870-4e42-8f29-df961cf44d5d","Type":"ContainerStarted","Data":"104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa"}
Sep 10 15:48:39.607152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:39.607156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn" event={"ID":"b89ec0eb-0870-4e42-8f29-df961cf44d5d","Type":"ContainerStarted","Data":"39ef6af5d3d57abb77aec3b58b6fb1ccb9cf595b4172605019181ac037169ef0"}
Sep 10 15:48:39.638839 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:39.638792    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn" podStartSLOduration=1.638776421 podStartE2EDuration="1.638776421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:48:39.636485635 +0000 UTC m=+996.451561400" watchObservedRunningTime="2026-09-10 15:48:39.638776421 +0000 UTC m=+996.453852162"
Sep 10 15:48:42.121872 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:42.121836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:42.225462 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:42.225417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:42.325859 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:42.325822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:43.047951 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:43.047908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:43.146404 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:43.146366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:45.332052 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:45.332015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:48.555775 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:48.555741    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:48.556154 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:48.555789    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:48.568697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:48.568673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:48.667617 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:48.667590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:48:50.143568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.143530    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"]
Sep 10 15:48:50.147244 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.147222    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.149641 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.149616    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-76a9b8\"/\"openshift-service-ca.crt\""
Sep 10 15:48:50.150510 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.150483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-76a9b8\"/\"explicit-model-76a9b8-kserve-self-signed-certs\""
Sep 10 15:48:50.150592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.150492    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-76a9b8\"/\"kube-root-ca.crt\""
Sep 10 15:48:50.150592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.150542    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-76a9b8\"/\"default-dockercfg-bx8rx\""
Sep 10 15:48:50.155156 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.155135    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"]
Sep 10 15:48:50.211877 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.211843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-model-cache\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.212042 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.211889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-home\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.212042 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.211953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.212042 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.212006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-dshm\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.212198 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.212090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxfpn\" (UniqueName: \"kubernetes.io/projected/4bdde273-ed02-466d-945a-932ec96d950a-kube-api-access-qxfpn\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.212198 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.212109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-tmp-dir\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.243978 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.243924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:50.313008 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.312954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-model-cache\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.313173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.313016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-home\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.313173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.313047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.313173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.313063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-dshm\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.313173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.313128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxfpn\" (UniqueName: \"kubernetes.io/projected/4bdde273-ed02-466d-945a-932ec96d950a-kube-api-access-qxfpn\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.313173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.313156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-tmp-dir\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.313446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.313395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-model-cache\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.313507 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.313455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-home\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.313583 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.313565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-tmp-dir\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.315427 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.315403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-dshm\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.316036 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.316016    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.320527 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.320505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxfpn\" (UniqueName: \"kubernetes.io/projected/4bdde273-ed02-466d-945a-932ec96d950a-kube-api-access-qxfpn\") pod \"explicit-model-76a9b8-kserve-788b5ccc95-d9lsj\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") " pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.457860 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.457826    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:48:50.542132 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.542095    2565 patch_prober.go:28] interesting pod/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:48:50.542285 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.542162    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:48:50.729687 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:50.729637    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"]
Sep 10 15:48:50.732265 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:48:50.732234    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bdde273_ed02_466d_945a_932ec96d950a.slice/crio-f88336b22f895c567032d548c008902e9c121c10c58ac690463041e56383e86d WatchSource:0}: Error finding container f88336b22f895c567032d548c008902e9c121c10c58ac690463041e56383e86d: Status 404 returned error can't find the container with id f88336b22f895c567032d548c008902e9c121c10c58ac690463041e56383e86d
Sep 10 15:48:51.676782 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.676747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" event={"ID":"4bdde273-ed02-466d-945a-932ec96d950a","Type":"ContainerStarted","Data":"aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082"}
Sep 10 15:48:51.677250 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.676794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" event={"ID":"4bdde273-ed02-466d-945a-932ec96d950a","Type":"ContainerStarted","Data":"f88336b22f895c567032d548c008902e9c121c10c58ac690463041e56383e86d"}
Sep 10 15:48:51.678365 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.678341    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerID="4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee" exitCode=0
Sep 10 15:48:51.678478 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.678412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" event={"ID":"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3","Type":"ContainerDied","Data":"4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee"}
Sep 10 15:48:51.678764 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.678751    2565 scope.go:117] "RemoveContainer" containerID="4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee"
Sep 10 15:48:51.679728 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.679701    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:48:51.679798 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.679763    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:48:51.679852 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.679800    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:48:51.691915 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:51.691863    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" podStartSLOduration=1.691838994 podStartE2EDuration="1.691838994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:48:51.691291036 +0000 UTC m=+1008.506366791" watchObservedRunningTime="2026-09-10 15:48:51.691838994 +0000 UTC m=+1008.506914736"
Sep 10 15:48:52.623062 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:52.623030    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"]
Sep 10 15:48:52.638742 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:52.638712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:52.685931 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:52.685890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" event={"ID":"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3","Type":"ContainerStarted","Data":"e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3"}
Sep 10 15:48:52.823047 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:52.823006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:52.839407 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:52.839375    2565 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-self-signed-certs: secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:48:52.839539 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:52.839462    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs podName:4bdde273-ed02-466d-945a-932ec96d950a nodeName:}" failed. No retries permitted until 2026-09-10 15:48:53.339440088 +0000 UTC m=+1010.154515819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs") pod "explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" (UID: "4bdde273-ed02-466d-945a-932ec96d950a") : secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:48:53.345665 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:53.345617    2565 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-self-signed-certs: secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:48:53.345883 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:53.345723    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs podName:4bdde273-ed02-466d-945a-932ec96d950a nodeName:}" failed. No retries permitted until 2026-09-10 15:48:54.3457018 +0000 UTC m=+1011.160777519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs") pod "explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" (UID: "4bdde273-ed02-466d-945a-932ec96d950a") : secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:48:53.533321 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:53.533282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:53.533501 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:53.533467    2565 patch_prober.go:28] interesting pod/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:48:53.533551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:53.533515    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 15:48:53.611360 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:53.611275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:54.357284 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:54.357236    2565 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-self-signed-certs: secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:48:54.357813 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:54.357336    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs podName:4bdde273-ed02-466d-945a-932ec96d950a nodeName:}" failed. No retries permitted until 2026-09-10 15:48:56.357310534 +0000 UTC m=+1013.172386254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs") pod "explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" (UID: "4bdde273-ed02-466d-945a-932ec96d950a") : secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:48:54.533402 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:54.533364    2565 patch_prober.go:28] interesting pod/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:48:54.533566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:54.533426    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 15:48:55.533552 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:55.533515    2565 patch_prober.go:28] interesting pod/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:48:55.533982 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:55.533573    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 15:48:55.546529 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:55.546482    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:48:56.377332 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:56.377294    2565 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-self-signed-certs: secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:48:56.377510 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:48:56.377373    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs podName:4bdde273-ed02-466d-945a-932ec96d950a nodeName:}" failed. No retries permitted until 2026-09-10 15:49:00.377358729 +0000 UTC m=+1017.192434446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs") pod "explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" (UID: "4bdde273-ed02-466d-945a-932ec96d950a") : secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:48:56.533626 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:56.533590    2565 patch_prober.go:28] interesting pod/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:48:56.534028 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:56.533643    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 15:48:57.533928 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:57.533889    2565 patch_prober.go:28] interesting pod/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 10 15:48:57.534337 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:57.533988    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 10 15:48:58.536433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:58.536404    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:58.536787 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:58.536699    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:58.537303 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:58.537285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:48:59.360529 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:59.360493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:59.469056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:59.469024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:59.579275 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:59.579243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:48:59.694360 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:48:59.694332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:00.339667 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:00.339636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:00.415428 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:49:00.415401    2565 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-self-signed-certs: secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:49:00.415638 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:49:00.415476    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs podName:4bdde273-ed02-466d-945a-932ec96d950a nodeName:}" failed. No retries permitted until 2026-09-10 15:49:08.415457897 +0000 UTC m=+1025.230533617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs") pod "explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" (UID: "4bdde273-ed02-466d-945a-932ec96d950a") : secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:49:00.437536 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:00.437504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:00.458175 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:00.458155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:49:00.537809 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:00.537784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:02.037731 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:02.037700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:03.164627 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.164582    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"]
Sep 10 15:49:03.165105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.164903    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z" podUID="0afbd5f6-8431-4ff3-a747-b34d3dd38954" containerName="maas-api" containerID="cri-o://1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52" gracePeriod=30
Sep 10 15:49:03.309209 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.307991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:03.387586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.387546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:03.412825 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.412798    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:49:03.444005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.443920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:03.545566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.545534    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-metrics-certs\") pod \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") "
Sep 10 15:49:03.545710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.545585    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls\") pod \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") "
Sep 10 15:49:03.545710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.545667    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0afbd5f6-8431-4ff3-a747-b34d3dd38954-openshift-service-ca\") pod \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") "
Sep 10 15:49:03.545710 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.545706    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztk66\" (UniqueName: \"kubernetes.io/projected/0afbd5f6-8431-4ff3-a747-b34d3dd38954-kube-api-access-ztk66\") pod \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\" (UID: \"0afbd5f6-8431-4ff3-a747-b34d3dd38954\") "
Sep 10 15:49:03.546090 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.546059    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0afbd5f6-8431-4ff3-a747-b34d3dd38954-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0afbd5f6-8431-4ff3-a747-b34d3dd38954" (UID: "0afbd5f6-8431-4ff3-a747-b34d3dd38954"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:49:03.547802 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.547768    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afbd5f6-8431-4ff3-a747-b34d3dd38954-kube-api-access-ztk66" (OuterVolumeSpecName: "kube-api-access-ztk66") pod "0afbd5f6-8431-4ff3-a747-b34d3dd38954" (UID: "0afbd5f6-8431-4ff3-a747-b34d3dd38954"). InnerVolumeSpecName "kube-api-access-ztk66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:49:03.548198 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.548173    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0afbd5f6-8431-4ff3-a747-b34d3dd38954" (UID: "0afbd5f6-8431-4ff3-a747-b34d3dd38954"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:49:03.548279 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.548211    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0afbd5f6-8431-4ff3-a747-b34d3dd38954" (UID: "0afbd5f6-8431-4ff3-a747-b34d3dd38954"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:49:03.646889 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.646853    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-metrics-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:03.646889 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.646886    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0afbd5f6-8431-4ff3-a747-b34d3dd38954-maas-api-tls\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:03.646889 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.646897    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0afbd5f6-8431-4ff3-a747-b34d3dd38954-openshift-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:03.647150 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.646909    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztk66\" (UniqueName: \"kubernetes.io/projected/0afbd5f6-8431-4ff3-a747-b34d3dd38954-kube-api-access-ztk66\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:03.742874 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.742782    2565 generic.go:356] "Generic (PLEG): container finished" podID="0afbd5f6-8431-4ff3-a747-b34d3dd38954" containerID="1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52" exitCode=0
Sep 10 15:49:03.742874 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.742832    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"
Sep 10 15:49:03.743106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.742825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z" event={"ID":"0afbd5f6-8431-4ff3-a747-b34d3dd38954","Type":"ContainerDied","Data":"1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52"}
Sep 10 15:49:03.743106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.742988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z" event={"ID":"0afbd5f6-8431-4ff3-a747-b34d3dd38954","Type":"ContainerDied","Data":"578c5bbd3b6c9299236ba931900d7f2932cbeae4a3c21383eee2982be9a66af2"}
Sep 10 15:49:03.743106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.743025    2565 scope.go:117] "RemoveContainer" containerID="1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52"
Sep 10 15:49:03.743649 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.743603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:03.753397 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.753380    2565 scope.go:117] "RemoveContainer" containerID="1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52"
Sep 10 15:49:03.753689 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:49:03.753671    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52\": container with ID starting with 1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52 not found: ID does not exist" containerID="1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52"
Sep 10 15:49:03.753735 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.753697    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52"} err="failed to get container status \"1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52\": rpc error: code = NotFound desc = could not find container \"1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52\": container with ID starting with 1f72951aa053f8f0c0cd87ff4d1334c2d83670c9900a2abc0ac87645842bac52 not found: ID does not exist"
Sep 10 15:49:03.765189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.765162    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"]
Sep 10 15:49:03.767134 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.767113    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-76a9b8-59dc7cd4f4-gp84z"]
Sep 10 15:49:03.824828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:03.824794    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afbd5f6-8431-4ff3-a747-b34d3dd38954" path="/var/lib/kubelet/pods/0afbd5f6-8431-4ff3-a747-b34d3dd38954/volumes"
Sep 10 15:49:07.664084 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:07.664043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:07.765284 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:07.765248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:08.326811 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:08.326774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:08.492761 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:49:08.492729    2565 secret.go:189] Couldn't get secret ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-self-signed-certs: secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:49:08.492922 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:49:08.492803    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs podName:4bdde273-ed02-466d-945a-932ec96d950a nodeName:}" failed. No retries permitted until 2026-09-10 15:49:24.492788188 +0000 UTC m=+1041.307863906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs") pod "explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" (UID: "4bdde273-ed02-466d-945a-932ec96d950a") : secret "explicit-model-76a9b8-kserve-self-signed-certs" not found
Sep 10 15:49:08.711192 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:08.711156    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" podUID="4bdde273-ed02-466d-945a-932ec96d950a" containerName="main" containerID="cri-o://aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082" gracePeriod=45
Sep 10 15:49:08.816047 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:08.816012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:08.951911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:08.951884    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:49:09.098055 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.097975    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs\") pod \"4bdde273-ed02-466d-945a-932ec96d950a\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") "
Sep 10 15:49:09.098055 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098043    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-dshm\") pod \"4bdde273-ed02-466d-945a-932ec96d950a\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") "
Sep 10 15:49:09.098278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098065    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-home\") pod \"4bdde273-ed02-466d-945a-932ec96d950a\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") "
Sep 10 15:49:09.098278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098117    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxfpn\" (UniqueName: \"kubernetes.io/projected/4bdde273-ed02-466d-945a-932ec96d950a-kube-api-access-qxfpn\") pod \"4bdde273-ed02-466d-945a-932ec96d950a\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") "
Sep 10 15:49:09.098278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-tmp-dir\") pod \"4bdde273-ed02-466d-945a-932ec96d950a\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") "
Sep 10 15:49:09.098278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098176    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-model-cache\") pod \"4bdde273-ed02-466d-945a-932ec96d950a\" (UID: \"4bdde273-ed02-466d-945a-932ec96d950a\") "
Sep 10 15:49:09.098494 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-home" (OuterVolumeSpecName: "home") pod "4bdde273-ed02-466d-945a-932ec96d950a" (UID: "4bdde273-ed02-466d-945a-932ec96d950a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:09.098494 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098430    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4bdde273-ed02-466d-945a-932ec96d950a" (UID: "4bdde273-ed02-466d-945a-932ec96d950a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:09.098581 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-model-cache" (OuterVolumeSpecName: "model-cache") pod "4bdde273-ed02-466d-945a-932ec96d950a" (UID: "4bdde273-ed02-466d-945a-932ec96d950a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:09.098581 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.098538    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:09.100278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.100250    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bdde273-ed02-466d-945a-932ec96d950a-kube-api-access-qxfpn" (OuterVolumeSpecName: "kube-api-access-qxfpn") pod "4bdde273-ed02-466d-945a-932ec96d950a" (UID: "4bdde273-ed02-466d-945a-932ec96d950a"). InnerVolumeSpecName "kube-api-access-qxfpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:49:09.100278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.100266    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-dshm" (OuterVolumeSpecName: "dshm") pod "4bdde273-ed02-466d-945a-932ec96d950a" (UID: "4bdde273-ed02-466d-945a-932ec96d950a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:09.100278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.100275    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4bdde273-ed02-466d-945a-932ec96d950a" (UID: "4bdde273-ed02-466d-945a-932ec96d950a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:49:09.199196 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.199158    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxfpn\" (UniqueName: \"kubernetes.io/projected/4bdde273-ed02-466d-945a-932ec96d950a-kube-api-access-qxfpn\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:09.199196 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.199194    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:09.199196 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.199207    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:09.199406 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.199214    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bdde273-ed02-466d-945a-932ec96d950a-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:09.199406 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.199223    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bdde273-ed02-466d-945a-932ec96d950a-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:09.777255 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.777211    2565 generic.go:356] "Generic (PLEG): container finished" podID="4bdde273-ed02-466d-945a-932ec96d950a" containerID="aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082" exitCode=0
Sep 10 15:49:09.777255 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.777252    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"
Sep 10 15:49:09.777729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.777280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" event={"ID":"4bdde273-ed02-466d-945a-932ec96d950a","Type":"ContainerDied","Data":"aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082"}
Sep 10 15:49:09.777729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.777310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj" event={"ID":"4bdde273-ed02-466d-945a-932ec96d950a","Type":"ContainerDied","Data":"f88336b22f895c567032d548c008902e9c121c10c58ac690463041e56383e86d"}
Sep 10 15:49:09.777729 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.777326    2565 scope.go:117] "RemoveContainer" containerID="aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082"
Sep 10 15:49:09.786739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.786716    2565 scope.go:117] "RemoveContainer" containerID="aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082"
Sep 10 15:49:09.787026 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:49:09.787007    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082\": container with ID starting with aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082 not found: ID does not exist" containerID="aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082"
Sep 10 15:49:09.787094 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.787040    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082"} err="failed to get container status \"aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082\": rpc error: code = NotFound desc = could not find container \"aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082\": container with ID starting with aa365b6529b41fb36d3c1b9635dc14570aa7b51846f0bb100f06c26bedb1e082 not found: ID does not exist"
Sep 10 15:49:09.797908 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.797887    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"]
Sep 10 15:49:09.800979 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.800943    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-76a9b8/explicit-model-76a9b8-kserve-788b5ccc95-d9lsj"]
Sep 10 15:49:09.824446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:09.824420    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bdde273-ed02-466d-945a-932ec96d950a" path="/var/lib/kubelet/pods/4bdde273-ed02-466d-945a-932ec96d950a/volumes"
Sep 10 15:49:13.041139 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:13.041098    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:49:14.451821 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.451783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:14.549517 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.549487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:14.674977 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.674925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:14.820135 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.820054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:14.959762 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.959730    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"]
Sep 10 15:49:14.960256 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.960234    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afbd5f6-8431-4ff3-a747-b34d3dd38954" containerName="maas-api"
Sep 10 15:49:14.960256 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.960256    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afbd5f6-8431-4ff3-a747-b34d3dd38954" containerName="maas-api"
Sep 10 15:49:14.960433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.960289    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bdde273-ed02-466d-945a-932ec96d950a" containerName="main"
Sep 10 15:49:14.960433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.960297    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bdde273-ed02-466d-945a-932ec96d950a" containerName="main"
Sep 10 15:49:14.960433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.960413    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0afbd5f6-8431-4ff3-a747-b34d3dd38954" containerName="maas-api"
Sep 10 15:49:14.960433 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.960427    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bdde273-ed02-466d-945a-932ec96d950a" containerName="main"
Sep 10 15:49:14.964837 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.964815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:14.967609 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.967588    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-25381b71-openshift-default-dockercfg-jwmmj\""
Sep 10 15:49:14.977616 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.977590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:14.978191 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:14.978171    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"]
Sep 10 15:49:15.046471 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pj6b\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-kube-api-access-7pj6b\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.046618 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-envoy\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.046618 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-socket\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.046618 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istiod-ca-cert\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.046867 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-certs\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.046867 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-data\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.046867 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-credential-socket\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.046867 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-podinfo\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.047137 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.046937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-token\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.050589 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.050564    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"]
Sep 10 15:49:15.050834 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.050807    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy" containerID="cri-o://e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3" gracePeriod=30
Sep 10 15:49:15.075590 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.075532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:15.148002 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.147977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-token\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pj6b\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-kube-api-access-7pj6b\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148160 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-envoy\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148254 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-socket\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148254 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istiod-ca-cert\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-certs\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-data\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-credential-socket\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-podinfo\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-socket\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.148863 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.148819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-data\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.149276 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.149177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istiod-ca-cert\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.149276 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.149209    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-certs\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.149276 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.149226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-credential-socket\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.150790 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.150751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-envoy\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.151406 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.151384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-podinfo\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.156374 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.156347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-token\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.157072 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.157037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pj6b\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-kube-api-access-7pj6b\") pod \"e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") " pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.187167 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.187141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:15.274241 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.274217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:15.517918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.517885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:15.555013 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.554990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"]
Sep 10 15:49:15.557538 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:49:15.557510    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5c1751_aa4f_44d3_98b9_2b7f0fd9a38e.slice/crio-5e9d66b38c7f7951205ad219606a5b96a96c0d8130dc090480b381c1ddab991c WatchSource:0}: Error finding container 5e9d66b38c7f7951205ad219606a5b96a96c0d8130dc090480b381c1ddab991c: Status 404 returned error can't find the container with id 5e9d66b38c7f7951205ad219606a5b96a96c0d8130dc090480b381c1ddab991c
Sep 10 15:49:15.559622 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.559589    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:49:15.559680 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.559668    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:49:15.559717 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.559696    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:49:15.817446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.817203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" event={"ID":"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e","Type":"ContainerStarted","Data":"88556933c3b43eab9006f7c9fe6142385f9ea4e1d45a4f8400a74400ed1718fc"}
Sep 10 15:49:15.817446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.817275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" event={"ID":"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e","Type":"ContainerStarted","Data":"5e9d66b38c7f7951205ad219606a5b96a96c0d8130dc090480b381c1ddab991c"}
Sep 10 15:49:15.835303 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.835221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:15.845572 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:15.845526    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" podStartSLOduration=1.8455111770000001 podStartE2EDuration="1.845511177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:49:15.844051252 +0000 UTC m=+1032.659127000" watchObservedRunningTime="2026-09-10 15:49:15.845511177 +0000 UTC m=+1032.660586919"
Sep 10 15:49:16.010898 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:16.010866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:16.275318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:16.275283    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:16.280082 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:16.280054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:16.822239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:16.822210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:16.823141 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:16.823120    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:17.533257 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:17.533219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:17.632611 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:17.632575    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:17.751134 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:17.751093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:17.851997 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:17.851892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:17.951409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:17.951378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:18.980542 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:18.980508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:19.080993 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:19.080943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:19.354402 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:19.354312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:20.090692 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.090663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:20.141974 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.141933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:20.306880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.306860    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:49:20.401716 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.401693    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-credential-socket\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.401875 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.401724    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-token\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.401875 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.401755    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istiod-ca-cert\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.401875 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.401778    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-envoy\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.402092 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.401896    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-certs\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.402092 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.401938    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-data\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.402092 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.401999    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-podinfo\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.402092 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:20.402296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-socket\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.402296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2czr\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-kube-api-access-n2czr\") pod \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\" (UID: \"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3\") "
Sep 10 15:49:20.402296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402169    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:20.402296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402238    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:20.402296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402275    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:49:20.402516 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402393    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:20.402581 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402558    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.402636 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402576    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.402636 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402592    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.402636 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402607    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.402636 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.402621    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.404101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.404072    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:49:20.404216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.404098    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:49:20.404216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.404100    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:49:20.404216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.404203    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-kube-api-access-n2czr" (OuterVolumeSpecName: "kube-api-access-n2czr") pod "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" (UID: "ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3"). InnerVolumeSpecName "kube-api-access-n2czr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:49:20.503909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.503887    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2czr\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-kube-api-access-n2czr\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.503909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.503907    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.504063 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.503917    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.504063 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.503925    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:49:20.843563 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.843469    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerID="e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3" exitCode=0
Sep 10 15:49:20.843563 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.843516    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"
Sep 10 15:49:20.843563 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.843546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" event={"ID":"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3","Type":"ContainerDied","Data":"e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3"}
Sep 10 15:49:20.843800 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.843593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m" event={"ID":"ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3","Type":"ContainerDied","Data":"4be098ba78596d304a84076ba1134d0ff634fbcf4e351000dd00233baaa0e66c"}
Sep 10 15:49:20.843800 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.843616    2565 scope.go:117] "RemoveContainer" containerID="e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3"
Sep 10 15:49:20.854186 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.854167    2565 scope.go:117] "RemoveContainer" containerID="4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee"
Sep 10 15:49:20.862868 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.862848    2565 scope.go:117] "RemoveContainer" containerID="e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3"
Sep 10 15:49:20.863263 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:49:20.863228    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3\": container with ID starting with e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3 not found: ID does not exist" containerID="e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3"
Sep 10 15:49:20.863351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.863276    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3"} err="failed to get container status \"e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3\": rpc error: code = NotFound desc = could not find container \"e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3\": container with ID starting with e3f80909ee73c89a44c745aeba054ce9e1810865051cd5f3eabaf631082531a3 not found: ID does not exist"
Sep 10 15:49:20.863351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.863302    2565 scope.go:117] "RemoveContainer" containerID="4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee"
Sep 10 15:49:20.863719 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:49:20.863651    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee\": container with ID starting with 4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee not found: ID does not exist" containerID="4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee"
Sep 10 15:49:20.863834 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.863683    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee"} err="failed to get container status \"4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee\": rpc error: code = NotFound desc = could not find container \"4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee\": container with ID starting with 4d096a9197096ad9812d0af114582c4cf2ab3faa0fe30872d150a2091be26fee not found: ID does not exist"
Sep 10 15:49:20.866069 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.866043    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"]
Sep 10 15:49:20.869920 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:20.869898    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-76a9b8-openshift-default-6f7964f47b-q4l4m"]
Sep 10 15:49:21.823803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:21.823763    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" path="/var/lib/kubelet/pods/ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3/volumes"
Sep 10 15:49:26.340074 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:26.340041    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:49:35.543828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.543787    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"]
Sep 10 15:49:35.544461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.544258    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy"
Sep 10 15:49:35.544461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.544272    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy"
Sep 10 15:49:35.544461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.544286    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy"
Sep 10 15:49:35.544461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.544292    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy"
Sep 10 15:49:35.544461 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.544355    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy"
Sep 10 15:49:35.547583 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.547564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.549946 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.549927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-f32d75\"/\"openshift-service-ca.crt\""
Sep 10 15:49:35.550800 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.550787    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-f32d75\"/\"kube-root-ca.crt\""
Sep 10 15:49:35.550883 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.550806    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-f32d75\"/\"noten-model-f32d75-kserve-self-signed-certs\""
Sep 10 15:49:35.550883 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.550824    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-f32d75\"/\"default-dockercfg-tptb9\""
Sep 10 15:49:35.555124 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.555103    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"]
Sep 10 15:49:35.647052 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.647022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:35.648123 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.648102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-tmp-dir\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.648219 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.648158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00db495f-5b79-47ba-a481-e5196daf58bf-tls-certs\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.648283 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.648216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-model-cache\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.648283 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.648273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-dshm\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.648381 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.648364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-home\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.648422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.648394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6nv2\" (UniqueName: \"kubernetes.io/projected/00db495f-5b79-47ba-a481-e5196daf58bf-kube-api-access-f6nv2\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.749600 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.749560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-tmp-dir\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.749787 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.749624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00db495f-5b79-47ba-a481-e5196daf58bf-tls-certs\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.749787 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.749649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-model-cache\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.749787 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.749682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-dshm\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.749787 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.749729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-home\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.749787 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.749754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6nv2\" (UniqueName: \"kubernetes.io/projected/00db495f-5b79-47ba-a481-e5196daf58bf-kube-api-access-f6nv2\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.750080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.750024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-tmp-dir\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.750080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.750052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-model-cache\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.750167 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.750143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-home\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.752071 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.752047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-dshm\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.752177 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.752119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00db495f-5b79-47ba-a481-e5196daf58bf-tls-certs\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.757703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.757684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6nv2\" (UniqueName: \"kubernetes.io/projected/00db495f-5b79-47ba-a481-e5196daf58bf-kube-api-access-f6nv2\") pod \"noten-model-f32d75-kserve-868b848f5f-rb5wk\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") " pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:35.858736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:35.858655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:36.131150 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.131122    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"]
Sep 10 15:49:36.133098 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:49:36.133048    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00db495f_5b79_47ba_a481_e5196daf58bf.slice/crio-983b6c91b0cd24783e9560e79c0cd6ba0ef7daad9fe6daa8d8455dc9d1d7c8a9 WatchSource:0}: Error finding container 983b6c91b0cd24783e9560e79c0cd6ba0ef7daad9fe6daa8d8455dc9d1d7c8a9: Status 404 returned error can't find the container with id 983b6c91b0cd24783e9560e79c0cd6ba0ef7daad9fe6daa8d8455dc9d1d7c8a9
Sep 10 15:49:36.935146 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.935051    2565 generic.go:356] "Generic (PLEG): container finished" podID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerID="88556933c3b43eab9006f7c9fe6142385f9ea4e1d45a4f8400a74400ed1718fc" exitCode=0
Sep 10 15:49:36.935146 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.935132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" event={"ID":"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e","Type":"ContainerDied","Data":"88556933c3b43eab9006f7c9fe6142385f9ea4e1d45a4f8400a74400ed1718fc"}
Sep 10 15:49:36.935658 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.935554    2565 scope.go:117] "RemoveContainer" containerID="88556933c3b43eab9006f7c9fe6142385f9ea4e1d45a4f8400a74400ed1718fc"
Sep 10 15:49:36.936783 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.936751    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:49:36.936895 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.936833    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:49:36.936895 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.936868    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:49:36.937005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.936868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk" event={"ID":"00db495f-5b79-47ba-a481-e5196daf58bf","Type":"ContainerStarted","Data":"5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3"}
Sep 10 15:49:36.937005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.936980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk" event={"ID":"00db495f-5b79-47ba-a481-e5196daf58bf","Type":"ContainerStarted","Data":"983b6c91b0cd24783e9560e79c0cd6ba0ef7daad9fe6daa8d8455dc9d1d7c8a9"}
Sep 10 15:49:36.973626 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:36.973574    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk" podStartSLOduration=1.9735569229999999 podStartE2EDuration="1.973556923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:49:36.972924757 +0000 UTC m=+1053.788000499" watchObservedRunningTime="2026-09-10 15:49:36.973556923 +0000 UTC m=+1053.788632662"
Sep 10 15:49:37.945216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:37.945173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" event={"ID":"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e","Type":"ContainerStarted","Data":"5a22f3f38376ecee7396d6d13fc67b308ee4e7a7102d4068f23c25f5a14ab305"}
Sep 10 15:49:38.274521 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:38.274427    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:38.274686 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:38.274665    2565 patch_prober.go:28] interesting pod/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:49:38.274739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:38.274720    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 15:49:39.275172 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:39.275132    2565 patch_prober.go:28] interesting pod/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:49:39.275577 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:39.275196    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 15:49:40.275292 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:40.275250    2565 patch_prober.go:28] interesting pod/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:49:40.275692 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:40.275311    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 15:49:41.275531 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:41.275490    2565 patch_prober.go:28] interesting pod/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:49:41.275942 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:41.275556    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 15:49:42.275594 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:42.275550    2565 patch_prober.go:28] interesting pod/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 10 15:49:42.276052 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:42.275615    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 10 15:49:42.805313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:42.805268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:43.279511 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:43.279477    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:43.279990 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:43.279905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:43.280590 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:43.280572    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:49:43.479821 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:43.479790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:43.578241 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:43.578145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:43.933215 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:43.933185    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:45.858811 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:45.858776    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:45.859279 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:45.858833    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:45.871049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:45.871021    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:46.014175 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:46.014143    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:49:47.153204 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:47.153163    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:49:49.858127 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:49.858090    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:49.959556 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:49.959519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:54.220537 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:54.220503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:55.222127 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:55.222083    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"]
Sep 10 15:49:55.248578 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:55.248543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:55.362210 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:55.362173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:55.572504 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:55.572408    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:55.683125 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:55.683081    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:56.133372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:56.133280    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"]
Sep 10 15:49:56.504836 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:56.504801    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:56.603217 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:56.603181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:49:59.253937 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:49:59.253898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:50:00.335409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:00.335371    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:00.762833 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:00.762799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:00.947297 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:00.947265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:01.169366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:01.169332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:01.275695 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:01.275665    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:01.518572 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:01.518488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:03.510979 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:03.507771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:06.388026 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:06.387987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:06.940377 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:06.940341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:07.040935 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:07.040900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:07.119318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:07.119286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:07.392335 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:07.392255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:07.489121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:07.489078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:07.733013 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:07.732951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:07.791807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:07.791774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:07.977503 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:07.977468    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"]
Sep 10 15:50:07.977691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:07.977669    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy" containerID="cri-o://5a22f3f38376ecee7396d6d13fc67b308ee4e7a7102d4068f23c25f5a14ab305" gracePeriod=30
Sep 10 15:50:08.004103 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:08.004037    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:08.334526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:08.334442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:08.436104 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:08.436070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:08.554140 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:08.554104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:10.242574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.242537    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk" podUID="00db495f-5b79-47ba-a481-e5196daf58bf" containerName="main" containerID="cri-o://5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3" gracePeriod=45
Sep 10 15:50:10.486634 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.486609    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:50:10.583805 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.583729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-dshm\") pod \"00db495f-5b79-47ba-a481-e5196daf58bf\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") "
Sep 10 15:50:10.583805 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.583773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-home\") pod \"00db495f-5b79-47ba-a481-e5196daf58bf\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") "
Sep 10 15:50:10.583805 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.583798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00db495f-5b79-47ba-a481-e5196daf58bf-tls-certs\") pod \"00db495f-5b79-47ba-a481-e5196daf58bf\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") "
Sep 10 15:50:10.584202 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.583815    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-tmp-dir\") pod \"00db495f-5b79-47ba-a481-e5196daf58bf\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") "
Sep 10 15:50:10.584202 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.583916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6nv2\" (UniqueName: \"kubernetes.io/projected/00db495f-5b79-47ba-a481-e5196daf58bf-kube-api-access-f6nv2\") pod \"00db495f-5b79-47ba-a481-e5196daf58bf\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") "
Sep 10 15:50:10.584202 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.583953    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-model-cache\") pod \"00db495f-5b79-47ba-a481-e5196daf58bf\" (UID: \"00db495f-5b79-47ba-a481-e5196daf58bf\") "
Sep 10 15:50:10.584202 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.584090    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-home" (OuterVolumeSpecName: "home") pod "00db495f-5b79-47ba-a481-e5196daf58bf" (UID: "00db495f-5b79-47ba-a481-e5196daf58bf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:10.584202 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.584180    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "00db495f-5b79-47ba-a481-e5196daf58bf" (UID: "00db495f-5b79-47ba-a481-e5196daf58bf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:10.584431 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.584258    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-model-cache" (OuterVolumeSpecName: "model-cache") pod "00db495f-5b79-47ba-a481-e5196daf58bf" (UID: "00db495f-5b79-47ba-a481-e5196daf58bf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:10.584431 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.584338    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:10.584431 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.584351    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:10.584431 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.584361    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:10.586138 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.586104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-dshm" (OuterVolumeSpecName: "dshm") pod "00db495f-5b79-47ba-a481-e5196daf58bf" (UID: "00db495f-5b79-47ba-a481-e5196daf58bf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:10.586246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.586151    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00db495f-5b79-47ba-a481-e5196daf58bf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "00db495f-5b79-47ba-a481-e5196daf58bf" (UID: "00db495f-5b79-47ba-a481-e5196daf58bf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:50:10.586246 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.586156    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00db495f-5b79-47ba-a481-e5196daf58bf-kube-api-access-f6nv2" (OuterVolumeSpecName: "kube-api-access-f6nv2") pod "00db495f-5b79-47ba-a481-e5196daf58bf" (UID: "00db495f-5b79-47ba-a481-e5196daf58bf"). InnerVolumeSpecName "kube-api-access-f6nv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:50:10.685731 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.685704    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00db495f-5b79-47ba-a481-e5196daf58bf-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:10.685731 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.685727    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00db495f-5b79-47ba-a481-e5196daf58bf-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:10.685922 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.685738    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6nv2\" (UniqueName: \"kubernetes.io/projected/00db495f-5b79-47ba-a481-e5196daf58bf-kube-api-access-f6nv2\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:10.841926 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:10.841842    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:50:11.134102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.134020    2565 generic.go:356] "Generic (PLEG): container finished" podID="00db495f-5b79-47ba-a481-e5196daf58bf" containerID="5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3" exitCode=0
Sep 10 15:50:11.134102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.134060    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"
Sep 10 15:50:11.134295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.134103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk" event={"ID":"00db495f-5b79-47ba-a481-e5196daf58bf","Type":"ContainerDied","Data":"5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3"}
Sep 10 15:50:11.134295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.134143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk" event={"ID":"00db495f-5b79-47ba-a481-e5196daf58bf","Type":"ContainerDied","Data":"983b6c91b0cd24783e9560e79c0cd6ba0ef7daad9fe6daa8d8455dc9d1d7c8a9"}
Sep 10 15:50:11.134295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.134161    2565 scope.go:117] "RemoveContainer" containerID="5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3"
Sep 10 15:50:11.143777 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.143757    2565 scope.go:117] "RemoveContainer" containerID="5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3"
Sep 10 15:50:11.144091 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:50:11.144072    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3\": container with ID starting with 5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3 not found: ID does not exist" containerID="5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3"
Sep 10 15:50:11.144145 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.144100    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3"} err="failed to get container status \"5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3\": rpc error: code = NotFound desc = could not find container \"5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3\": container with ID starting with 5269554abfeecbf8a6e85a00ca4a1ad262becb0fe1028d4636cb0ec1a8aff2e3 not found: ID does not exist"
Sep 10 15:50:11.153147 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.153083    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn" podUID="b89ec0eb-0870-4e42-8f29-df961cf44d5d" containerName="main" containerID="cri-o://104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa" gracePeriod=45
Sep 10 15:50:11.155335 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.155314    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"]
Sep 10 15:50:11.159102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.159081    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-f32d75/noten-model-f32d75-kserve-868b848f5f-rb5wk"]
Sep 10 15:50:11.404974 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.404938    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:50:11.492583 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.492553    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-dshm\") pod \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") "
Sep 10 15:50:11.492736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.492612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tmp-dir\") pod \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") "
Sep 10 15:50:11.492736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.492648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt76h\" (UniqueName: \"kubernetes.io/projected/b89ec0eb-0870-4e42-8f29-df961cf44d5d-kube-api-access-dt76h\") pod \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") "
Sep 10 15:50:11.492736 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.492729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-model-cache\") pod \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") "
Sep 10 15:50:11.492903 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.492760    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tls-certs\") pod \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") "
Sep 10 15:50:11.492903 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.492820    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-home\") pod \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\" (UID: \"b89ec0eb-0870-4e42-8f29-df961cf44d5d\") "
Sep 10 15:50:11.492903 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.492856    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b89ec0eb-0870-4e42-8f29-df961cf44d5d" (UID: "b89ec0eb-0870-4e42-8f29-df961cf44d5d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:11.493078 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.493030    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-model-cache" (OuterVolumeSpecName: "model-cache") pod "b89ec0eb-0870-4e42-8f29-df961cf44d5d" (UID: "b89ec0eb-0870-4e42-8f29-df961cf44d5d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:11.493148 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.493123    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-home" (OuterVolumeSpecName: "home") pod "b89ec0eb-0870-4e42-8f29-df961cf44d5d" (UID: "b89ec0eb-0870-4e42-8f29-df961cf44d5d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:11.493222 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.493204    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:11.493261 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.493227    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:11.494789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.494769    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-dshm" (OuterVolumeSpecName: "dshm") pod "b89ec0eb-0870-4e42-8f29-df961cf44d5d" (UID: "b89ec0eb-0870-4e42-8f29-df961cf44d5d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:11.494855 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.494803    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b89ec0eb-0870-4e42-8f29-df961cf44d5d" (UID: "b89ec0eb-0870-4e42-8f29-df961cf44d5d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:50:11.494899 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.494880    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b89ec0eb-0870-4e42-8f29-df961cf44d5d-kube-api-access-dt76h" (OuterVolumeSpecName: "kube-api-access-dt76h") pod "b89ec0eb-0870-4e42-8f29-df961cf44d5d" (UID: "b89ec0eb-0870-4e42-8f29-df961cf44d5d"). InnerVolumeSpecName "kube-api-access-dt76h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:50:11.594571 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.594547    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:11.594571 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.594568    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89ec0eb-0870-4e42-8f29-df961cf44d5d-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:11.594714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.594577    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt76h\" (UniqueName: \"kubernetes.io/projected/b89ec0eb-0870-4e42-8f29-df961cf44d5d-kube-api-access-dt76h\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:11.594714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.594586    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89ec0eb-0870-4e42-8f29-df961cf44d5d-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:11.824384 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:11.824351    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00db495f-5b79-47ba-a481-e5196daf58bf" path="/var/lib/kubelet/pods/00db495f-5b79-47ba-a481-e5196daf58bf/volumes"
Sep 10 15:50:12.140605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.140522    2565 generic.go:356] "Generic (PLEG): container finished" podID="b89ec0eb-0870-4e42-8f29-df961cf44d5d" containerID="104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa" exitCode=0
Sep 10 15:50:12.140605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.140564    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"
Sep 10 15:50:12.140824 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.140609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn" event={"ID":"b89ec0eb-0870-4e42-8f29-df961cf44d5d","Type":"ContainerDied","Data":"104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa"}
Sep 10 15:50:12.140824 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.140654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn" event={"ID":"b89ec0eb-0870-4e42-8f29-df961cf44d5d","Type":"ContainerDied","Data":"39ef6af5d3d57abb77aec3b58b6fb1ccb9cf595b4172605019181ac037169ef0"}
Sep 10 15:50:12.140824 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.140672    2565 scope.go:117] "RemoveContainer" containerID="104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa"
Sep 10 15:50:12.149049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.149030    2565 scope.go:117] "RemoveContainer" containerID="104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa"
Sep 10 15:50:12.149301 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:50:12.149280    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa\": container with ID starting with 104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa not found: ID does not exist" containerID="104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa"
Sep 10 15:50:12.149366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.149312    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa"} err="failed to get container status \"104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa\": rpc error: code = NotFound desc = could not find container \"104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa\": container with ID starting with 104c067cd81493788ac8eb8c4fa0c0858f899afe0e1ddb9dc7636593b2e6f7fa not found: ID does not exist"
Sep 10 15:50:12.156858 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.156835    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"]
Sep 10 15:50:12.162463 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:12.162444    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8a850d/test-model-8a850d-kserve-67b9696f65-x7qhn"]
Sep 10 15:50:13.149283 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.149253    2565 generic.go:356] "Generic (PLEG): container finished" podID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerID="5a22f3f38376ecee7396d6d13fc67b308ee4e7a7102d4068f23c25f5a14ab305" exitCode=0
Sep 10 15:50:13.149646 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.149325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" event={"ID":"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e","Type":"ContainerDied","Data":"5a22f3f38376ecee7396d6d13fc67b308ee4e7a7102d4068f23c25f5a14ab305"}
Sep 10 15:50:13.149646 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.149383    2565 scope.go:117] "RemoveContainer" containerID="88556933c3b43eab9006f7c9fe6142385f9ea4e1d45a4f8400a74400ed1718fc"
Sep 10 15:50:13.227853 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.227823    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:50:13.232387 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.232361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:13.288534 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.288467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:13.309435 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309410    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-credential-socket\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309459    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-certs\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309487    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-data\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309521    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pj6b\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-kube-api-access-7pj6b\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309537    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-envoy\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309577    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-socket\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309603    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istiod-ca-cert\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309651    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-podinfo\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309663    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:13.309683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-token\") pod \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\" (UID: \"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e\") "
Sep 10 15:50:13.309990 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309786    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:13.309990 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309863    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:13.309990 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309949    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.309990 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309952    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:13.309990 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.309985    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.310253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.310208    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:50:13.311788 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.311763    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:50:13.311896 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.311795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:50:13.312088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.312071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-kube-api-access-7pj6b" (OuterVolumeSpecName: "kube-api-access-7pj6b") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "kube-api-access-7pj6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:50:13.312143 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.312069    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" (UID: "3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:50:13.410723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.410686    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.410723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.410717    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.410723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.410726    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.410942 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.410734    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.410942 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.410743    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pj6b\" (UniqueName: \"kubernetes.io/projected/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-kube-api-access-7pj6b\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.410942 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.410752    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.410942 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.410759    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:13.506149 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.506119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:13.823762 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.823727    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b89ec0eb-0870-4e42-8f29-df961cf44d5d" path="/var/lib/kubelet/pods/b89ec0eb-0870-4e42-8f29-df961cf44d5d/volumes"
Sep 10 15:50:13.994843 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:13.994807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:14.156432 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:14.156407    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"
Sep 10 15:50:14.156432 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:14.156417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj" event={"ID":"3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e","Type":"ContainerDied","Data":"5e9d66b38c7f7951205ad219606a5b96a96c0d8130dc090480b381c1ddab991c"}
Sep 10 15:50:14.156892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:14.156470    2565 scope.go:117] "RemoveContainer" containerID="5a22f3f38376ecee7396d6d13fc67b308ee4e7a7102d4068f23c25f5a14ab305"
Sep 10 15:50:14.173625 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:14.173601    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"]
Sep 10 15:50:14.179395 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:14.179375    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-25381b71-openshift-default-5dc76557b4-zsjmj"]
Sep 10 15:50:14.677021 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:14.676988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:14.777826 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:14.777798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:14.874870 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:14.874840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:15.034745 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:15.034645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:15.823758 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:15.823724    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" path="/var/lib/kubelet/pods/3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e/volumes"
Sep 10 15:50:20.642159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:20.642109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:20.700505 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:20.700468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:21.542131 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.542072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:21.817305 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817222    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"]
Sep 10 15:50:21.817659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817594    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy"
Sep 10 15:50:21.817659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817606    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy"
Sep 10 15:50:21.817659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817621    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89ec0eb-0870-4e42-8f29-df961cf44d5d" containerName="main"
Sep 10 15:50:21.817659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817627    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89ec0eb-0870-4e42-8f29-df961cf44d5d" containerName="main"
Sep 10 15:50:21.817659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817642    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00db495f-5b79-47ba-a481-e5196daf58bf" containerName="main"
Sep 10 15:50:21.817659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817648    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="00db495f-5b79-47ba-a481-e5196daf58bf" containerName="main"
Sep 10 15:50:21.817659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817655    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy"
Sep 10 15:50:21.817659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817660    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy"
Sep 10 15:50:21.817943 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817719    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="00db495f-5b79-47ba-a481-e5196daf58bf" containerName="main"
Sep 10 15:50:21.817943 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817726    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba58f5eb-31a6-45d1-9fdd-db0b457cc0c3" containerName="istio-proxy"
Sep 10 15:50:21.817943 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817732    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy"
Sep 10 15:50:21.817943 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817738    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b89ec0eb-0870-4e42-8f29-df961cf44d5d" containerName="main"
Sep 10 15:50:21.817943 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.817744    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d5c1751-aa4f-44d3-98b9-2b7f0fd9a38e" containerName="istio-proxy"
Sep 10 15:50:21.822354 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.822325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.824951 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.824923    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-8e3dc2-openshift-default-dockercfg-qlp8f\""
Sep 10 15:50:21.825089 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.825010    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 15:50:21.833278 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.833256    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"]
Sep 10 15:50:21.852698 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.852675    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:21.984528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-podinfo\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.984753 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-token\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.984753 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2489ca51-e18a-465c-889a-7a8fa82d6372-istiod-ca-cert\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.984753 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-socket\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.984753 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdb2\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-kube-api-access-nkdb2\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.984753 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-envoy\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.985035 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-data\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.985035 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-certs\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:21.985035 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:21.984871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-credential-socket\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.085884 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.085791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-podinfo\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.085884 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.085827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-token\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.085884 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.085858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2489ca51-e18a-465c-889a-7a8fa82d6372-istiod-ca-cert\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.085884 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.085883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-socket\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.085916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdb2\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-kube-api-access-nkdb2\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.085936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-envoy\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.085983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-data\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.086020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-certs\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086288 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.086047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-credential-socket\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086559 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.086455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-data\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086559 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.086500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-credential-socket\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086559 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.086529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-socket\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.086599    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2489ca51-e18a-465c-889a-7a8fa82d6372-istiod-ca-cert\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.086703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.086606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-certs\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.088357 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.088340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-envoy\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.088559 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.088542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-podinfo\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.094245 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.094216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-token\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.094827 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.094808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdb2\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-kube-api-access-nkdb2\") pod \"e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") " pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.125170 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.125141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:22.133737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.133716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:22.408440 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.405354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"]
Sep 10 15:50:22.409057 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:50:22.409016    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2489ca51_e18a_465c_889a_7a8fa82d6372.slice/crio-b3da9ff743f6e06626918403d6ccdda33af33e4e6e10acc731ca39911ebf89c8 WatchSource:0}: Error finding container b3da9ff743f6e06626918403d6ccdda33af33e4e6e10acc731ca39911ebf89c8: Status 404 returned error can't find the container with id b3da9ff743f6e06626918403d6ccdda33af33e4e6e10acc731ca39911ebf89c8
Sep 10 15:50:22.411518 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.411483    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:22.411599 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.411554    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:22.411599 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:22.411591    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:23.207993 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:23.207937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" event={"ID":"2489ca51-e18a-465c-889a-7a8fa82d6372","Type":"ContainerStarted","Data":"af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca"}
Sep 10 15:50:23.208417 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:23.208020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" event={"ID":"2489ca51-e18a-465c-889a-7a8fa82d6372","Type":"ContainerStarted","Data":"b3da9ff743f6e06626918403d6ccdda33af33e4e6e10acc731ca39911ebf89c8"}
Sep 10 15:50:23.228135 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:23.228083    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" podStartSLOduration=2.228068105 podStartE2EDuration="2.228068105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:50:23.226320186 +0000 UTC m=+1100.041395927" watchObservedRunningTime="2026-09-10 15:50:23.228068105 +0000 UTC m=+1100.043143844"
Sep 10 15:50:24.134392 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.134356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:24.139441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.139415    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:24.213121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.213095    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:24.214043 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.214023    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:24.265598 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.265564    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"]
Sep 10 15:50:24.265875 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.265842    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv" podUID="e4956ef0-c540-47f0-b93f-b65deba2cb26" containerName="maas-api" containerID="cri-o://7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604" gracePeriod=30
Sep 10 15:50:24.294553 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.294518    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:24.395240 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.395168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:24.496026 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.495995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:24.509907 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.509886    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:50:24.595642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.595612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:24.607635 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.607598    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-metrics-certs\") pod \"e4956ef0-c540-47f0-b93f-b65deba2cb26\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") "
Sep 10 15:50:24.607780 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.607718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4956ef0-c540-47f0-b93f-b65deba2cb26-openshift-service-ca\") pod \"e4956ef0-c540-47f0-b93f-b65deba2cb26\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") "
Sep 10 15:50:24.607780 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.607763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls\") pod \"e4956ef0-c540-47f0-b93f-b65deba2cb26\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") "
Sep 10 15:50:24.607911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.607793    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glt4w\" (UniqueName: \"kubernetes.io/projected/e4956ef0-c540-47f0-b93f-b65deba2cb26-kube-api-access-glt4w\") pod \"e4956ef0-c540-47f0-b93f-b65deba2cb26\" (UID: \"e4956ef0-c540-47f0-b93f-b65deba2cb26\") "
Sep 10 15:50:24.608217 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.608179    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4956ef0-c540-47f0-b93f-b65deba2cb26-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4956ef0-c540-47f0-b93f-b65deba2cb26" (UID: "e4956ef0-c540-47f0-b93f-b65deba2cb26"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:50:24.609858 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.609833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4956ef0-c540-47f0-b93f-b65deba2cb26" (UID: "e4956ef0-c540-47f0-b93f-b65deba2cb26"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:50:24.609982 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.609884    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e4956ef0-c540-47f0-b93f-b65deba2cb26" (UID: "e4956ef0-c540-47f0-b93f-b65deba2cb26"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:50:24.610291 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.610274    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4956ef0-c540-47f0-b93f-b65deba2cb26-kube-api-access-glt4w" (OuterVolumeSpecName: "kube-api-access-glt4w") pod "e4956ef0-c540-47f0-b93f-b65deba2cb26" (UID: "e4956ef0-c540-47f0-b93f-b65deba2cb26"). InnerVolumeSpecName "kube-api-access-glt4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:50:24.709361 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.709324    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4956ef0-c540-47f0-b93f-b65deba2cb26-openshift-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:24.709361 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.709359    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-maas-api-tls\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:24.709361 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.709369    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glt4w\" (UniqueName: \"kubernetes.io/projected/e4956ef0-c540-47f0-b93f-b65deba2cb26-kube-api-access-glt4w\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:24.709551 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.709379    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4956ef0-c540-47f0-b93f-b65deba2cb26-metrics-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:50:24.861432 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:24.861405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:25.161354 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.161318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:25.218747 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.218718    2565 generic.go:356] "Generic (PLEG): container finished" podID="e4956ef0-c540-47f0-b93f-b65deba2cb26" containerID="7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604" exitCode=0
Sep 10 15:50:25.219189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.218762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv" event={"ID":"e4956ef0-c540-47f0-b93f-b65deba2cb26","Type":"ContainerDied","Data":"7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604"}
Sep 10 15:50:25.219189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.218781    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"
Sep 10 15:50:25.219189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.218811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv" event={"ID":"e4956ef0-c540-47f0-b93f-b65deba2cb26","Type":"ContainerDied","Data":"3ee600756a4d4dda471267744bf20e4bd089f13ceaa548d091eef3a7e1aa43cb"}
Sep 10 15:50:25.219189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.218833    2565 scope.go:117] "RemoveContainer" containerID="7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604"
Sep 10 15:50:25.228059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.228040    2565 scope.go:117] "RemoveContainer" containerID="7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604"
Sep 10 15:50:25.228342 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:50:25.228324    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604\": container with ID starting with 7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604 not found: ID does not exist" containerID="7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604"
Sep 10 15:50:25.228408 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.228363    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604"} err="failed to get container status \"7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604\": rpc error: code = NotFound desc = could not find container \"7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604\": container with ID starting with 7851146bdfdfb439cc4603ff5aedfd83406c39d7ead26974b189de53d437c604 not found: ID does not exist"
Sep 10 15:50:25.239491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.239471    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"]
Sep 10 15:50:25.243410 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.243376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:25.245654 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.245634    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a850d-584997f68f-72tzv"]
Sep 10 15:50:25.824098 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:25.824061    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4956ef0-c540-47f0-b93f-b65deba2cb26" path="/var/lib/kubelet/pods/e4956ef0-c540-47f0-b93f-b65deba2cb26/volumes"
Sep 10 15:50:26.396676 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:26.396647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:26.503688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:26.503652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:26.806533 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:26.806497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:27.032759 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:27.032725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:27.095489 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:27.095390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:30.148602 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:30.148568    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:50:30.816035 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:30.816003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:30.916723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:30.916688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:31.072732 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.072642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:31.612221 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.612185    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:31.908795 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.908765    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"]
Sep 10 15:50:31.909182 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.909169    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4956ef0-c540-47f0-b93f-b65deba2cb26" containerName="maas-api"
Sep 10 15:50:31.909229 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.909185    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4956ef0-c540-47f0-b93f-b65deba2cb26" containerName="maas-api"
Sep 10 15:50:31.909279 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.909267    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4956ef0-c540-47f0-b93f-b65deba2cb26" containerName="maas-api"
Sep 10 15:50:31.912307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.912288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:31.914842 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.914822    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-6f8c71-openshift-default-dockercfg-8w8ng\""
Sep 10 15:50:31.925629 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.925606    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"]
Sep 10 15:50:31.962934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:31.962897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:32.080932 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.080895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-socket\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.080932 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.080940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7krm\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-kube-api-access-n7krm\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.081190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.081007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-token\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.081190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.081024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istiod-ca-cert\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.081190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.081057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-envoy\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.081190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.081133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-podinfo\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.081190 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.081180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-certs\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.081401 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.081202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-credential-socket\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.081401 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.081260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-data\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.167482 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.167387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:32.182612 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.182579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-certs\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.182612 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.182615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-credential-socket\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.182819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.182644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-data\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.182819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.182687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-socket\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.182819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.182731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7krm\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-kube-api-access-n7krm\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.182819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.182773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-token\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.182819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.182790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istiod-ca-cert\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.183102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.182927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-envoy\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.183102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.183005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-podinfo\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.183199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.183107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-data\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.183199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.183126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-socket\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.183199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.183171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-certs\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.183316 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.183205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-credential-socket\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.183709 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.183687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istiod-ca-cert\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.185274 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.185257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-envoy\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.185414 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.185396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-podinfo\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.191262 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.191237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7krm\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-kube-api-access-n7krm\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.191566 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.191544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-token\") pod \"e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") " pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.222569 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.222534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:32.523511 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.523484    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"]
Sep 10 15:50:32.526290 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:50:32.526254    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10b9c4b_ac37_4737_9d97_60bc11bcc230.slice/crio-1acdbfdc75ecacafe7e60197887716e7aa6d571a8539a59ea401399bd8130cd7 WatchSource:0}: Error finding container 1acdbfdc75ecacafe7e60197887716e7aa6d571a8539a59ea401399bd8130cd7: Status 404 returned error can't find the container with id 1acdbfdc75ecacafe7e60197887716e7aa6d571a8539a59ea401399bd8130cd7
Sep 10 15:50:32.528600 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.528564    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:32.528693 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.528668    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:32.528759 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:32.528714    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:33.276394 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:33.276356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" event={"ID":"e10b9c4b-ac37-4737-9d97-60bc11bcc230","Type":"ContainerStarted","Data":"056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45"}
Sep 10 15:50:33.276802 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:33.276413    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" event={"ID":"e10b9c4b-ac37-4737-9d97-60bc11bcc230","Type":"ContainerStarted","Data":"1acdbfdc75ecacafe7e60197887716e7aa6d571a8539a59ea401399bd8130cd7"}
Sep 10 15:50:33.296921 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:33.296868    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" podStartSLOduration=2.296852647 podStartE2EDuration="2.296852647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:50:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:50:33.294172264 +0000 UTC m=+1110.109248005" watchObservedRunningTime="2026-09-10 15:50:33.296852647 +0000 UTC m=+1110.111928399"
Sep 10 15:50:34.223453 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:34.223410    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:34.228527 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:34.228502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:34.281418 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:34.281382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:34.282443 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:34.282418    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:35.207296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:35.207239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:35.293006 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:35.292954    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:36.405973 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:36.405925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:36.515303 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:36.515272    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:36.640148 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:36.640112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:36.877087 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:36.877054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:36.967843 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:36.967783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:38.053110 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:38.053068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:39.781632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:39.781095    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:59694->10.132.0.52:15021: read: connection reset by peer" start-of-body=
Sep 10 15:50:39.781632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:39.781160    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:59694->10.132.0.52:15021: read: connection reset by peer"
Sep 10 15:50:40.312786 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:40.312751    2565 generic.go:356] "Generic (PLEG): container finished" podID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerID="af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca" exitCode=0
Sep 10 15:50:40.313054 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:40.312826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" event={"ID":"2489ca51-e18a-465c-889a-7a8fa82d6372","Type":"ContainerDied","Data":"af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca"}
Sep 10 15:50:40.313271 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:40.313256    2565 scope.go:117] "RemoveContainer" containerID="af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca"
Sep 10 15:50:40.314299 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:40.314270    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:40.314357 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:40.314339    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:40.314393 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:40.314371    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:40.448365 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:40.448327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:50:41.107674 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:41.107574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:41.320341 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:41.320303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" event={"ID":"2489ca51-e18a-465c-889a-7a8fa82d6372","Type":"ContainerStarted","Data":"b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf"}
Sep 10 15:50:42.134546 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:42.134510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:42.135097 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:42.134844    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:50:42.135097 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:42.134905    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 15:50:43.134745 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:43.134705    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:50:43.135167 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:43.134777    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 15:50:44.134633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:44.134597    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:50:44.134838 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:44.134689    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 15:50:45.134498 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:45.134461    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:50:45.134669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:45.134521    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 15:50:46.134832 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:46.134794    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 15:50:46.135313 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:46.134861    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 15:50:47.138249 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:47.138222    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:47.138586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:47.138566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:47.139222 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:47.139205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:50:48.276286 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:48.276241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:49.885754 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:49.885282    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:51616->10.132.0.53:15021: read: connection reset by peer" start-of-body=
Sep 10 15:50:49.885754 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:49.885347    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:51616->10.132.0.53:15021: read: connection reset by peer"
Sep 10 15:50:50.083448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.083369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:50.374383 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.374350    2565 generic.go:356] "Generic (PLEG): container finished" podID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerID="056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45" exitCode=0
Sep 10 15:50:50.374557 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.374422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" event={"ID":"e10b9c4b-ac37-4737-9d97-60bc11bcc230","Type":"ContainerDied","Data":"056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45"}
Sep 10 15:50:50.374807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.374792    2565 scope.go:117] "RemoveContainer" containerID="056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45"
Sep 10 15:50:50.375767 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.375741    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:50.375827 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.375806    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:50.375879 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.375842    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:50.419983 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.419939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:50.682592 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.682556    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"]
Sep 10 15:50:50.686397 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.686374    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.688879 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.688855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-761990-openshift-default-dockercfg-7zlcv\""
Sep 10 15:50:50.699406 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.699375    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"]
Sep 10 15:50:50.724669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.724627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-envoy\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psd74\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-kube-api-access-psd74\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-certs\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-socket\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-podinfo\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-token\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdcf8b28-ba13-4672-814f-d092bc3d2565-istiod-ca-cert\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-data\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.768668 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.768542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-credential-socket\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.832147 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.832115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:50.869888 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.869851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-envoy\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.869888 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.869888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psd74\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-kube-api-access-psd74\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870163 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.869908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-certs\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870163 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.869927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-socket\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870163 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.870006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-podinfo\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870163 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.870028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-token\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870384 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.870352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-certs\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870524 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.870498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-socket\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870587 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.870564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdcf8b28-ba13-4672-814f-d092bc3d2565-istiod-ca-cert\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870641 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.870628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-data\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870704 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.870660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-credential-socket\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.870933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.870908    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-data\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.871035 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.871012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-credential-socket\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.871245 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.871226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdcf8b28-ba13-4672-814f-d092bc3d2565-istiod-ca-cert\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.872498 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.872469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-envoy\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.872647 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.872632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-podinfo\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.877669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.877643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-token\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:50.877843 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:50.877826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psd74\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-kube-api-access-psd74\") pod \"e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") " pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:51.000424 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.000315    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:51.297691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.297662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"]
Sep 10 15:50:51.299235 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:50:51.299209    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdcf8b28_ba13_4672_814f_d092bc3d2565.slice/crio-bbdf21af66d2a6abec2b2bbcca2f354a00c15dbc55bb132bb4439b1e51339ba9 WatchSource:0}: Error finding container bbdf21af66d2a6abec2b2bbcca2f354a00c15dbc55bb132bb4439b1e51339ba9: Status 404 returned error can't find the container with id bbdf21af66d2a6abec2b2bbcca2f354a00c15dbc55bb132bb4439b1e51339ba9
Sep 10 15:50:51.301513 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.301477    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:51.301590 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.301543    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:51.301590 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.301571    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:50:51.381617 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.381585    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" event={"ID":"e10b9c4b-ac37-4737-9d97-60bc11bcc230","Type":"ContainerStarted","Data":"41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac"}
Sep 10 15:50:51.383348 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.383324    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" event={"ID":"cdcf8b28-ba13-4672-814f-d092bc3d2565","Type":"ContainerStarted","Data":"73d59d80f2102d0787542fcb55ae3c030e7cda937c2e83d31ef1fda2d5ad87d1"}
Sep 10 15:50:51.383462 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.383384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" event={"ID":"cdcf8b28-ba13-4672-814f-d092bc3d2565","Type":"ContainerStarted","Data":"bbdf21af66d2a6abec2b2bbcca2f354a00c15dbc55bb132bb4439b1e51339ba9"}
Sep 10 15:50:51.423250 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:51.423195    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" podStartSLOduration=1.423174395 podStartE2EDuration="1.423174395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:50:51.419723536 +0000 UTC m=+1128.234799275" watchObservedRunningTime="2026-09-10 15:50:51.423174395 +0000 UTC m=+1128.238250137"
Sep 10 15:50:52.001208 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:52.001177    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:52.006507 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:52.006478    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:52.223179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:52.223143    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:52.223347 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:52.223305    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 10 15:50:52.223392 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:52.223349    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 10 15:50:52.388939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:52.388854    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:52.389848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:52.389826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:50:53.223595 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:53.223560    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 10 15:50:53.223994 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:53.223627    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 10 15:50:53.333488 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:53.333436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:53.423860 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:53.423819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:54.223376 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:54.223339    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 10 15:50:54.223558 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:54.223394    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 10 15:50:55.054067 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:55.054031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:55.158676 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:55.158639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:55.223068 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:55.223034    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 10 15:50:55.223222 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:55.223105    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 10 15:50:56.223307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:56.223266    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 10 15:50:56.223779 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:56.223330    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 10 15:50:57.226813 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:57.226782    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:57.227225 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:57.227045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:57.227616 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:57.227602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 15:50:57.490725 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:57.490630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:50:59.051414 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:50:59.051380    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:51:00.141259 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.141225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:00.456142 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.456102    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:00.724492 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.724406    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"]
Sep 10 15:51:00.729780 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.729759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.732628 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.732609    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-e412c4-openshift-default-dockercfg-qslp5\""
Sep 10 15:51:00.739441 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.739413    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"]
Sep 10 15:51:00.757161 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.757121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:00.863642 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.863600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-podinfo\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.863944 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.863919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjwzh\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-kube-api-access-jjwzh\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.864158 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.864140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-credential-socket\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.864294 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.864279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7fe8f91-e29d-40d8-a087-0211040f014a-istiod-ca-cert\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.864411 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.864394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-token\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.864578 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.864563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-certs\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.864697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.864683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-socket\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.864807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.864794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-envoy\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.864922 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.864906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-data\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.965929 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.965882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-podinfo\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.966268 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.966230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjwzh\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-kube-api-access-jjwzh\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.966401 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.966321    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-credential-socket\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.966401 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.966356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7fe8f91-e29d-40d8-a087-0211040f014a-istiod-ca-cert\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.966401 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.966388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-token\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.966775 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.966750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-certs\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.966940 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.966924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-socket\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.967041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.966777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-credential-socket\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.967041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.967032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-envoy\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.967162 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.967036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-certs\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.967162 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.967106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-data\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.967388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.967362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-socket\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.967531 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.967504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7fe8f91-e29d-40d8-a087-0211040f014a-istiod-ca-cert\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.967602 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.967463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-data\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.969235 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.969189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-envoy\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.969700 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.969677    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-podinfo\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.974766 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.974710    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-token\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:00.975040 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:00.975021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjwzh\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-kube-api-access-jjwzh\") pod \"e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") " pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:01.042127 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.042088    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:01.333364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.333336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"]
Sep 10 15:51:01.335505 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:01.335476    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fe8f91_e29d_40d8_a087_0211040f014a.slice/crio-9d3717e91dedc27c3add7eb901a0ae6b126067f95905846a945992614f3b36b9 WatchSource:0}: Error finding container 9d3717e91dedc27c3add7eb901a0ae6b126067f95905846a945992614f3b36b9: Status 404 returned error can't find the container with id 9d3717e91dedc27c3add7eb901a0ae6b126067f95905846a945992614f3b36b9
Sep 10 15:51:01.338193 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.338161    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:01.338254 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.338228    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:01.338293 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.338258    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:01.436480 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.436448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" event={"ID":"f7fe8f91-e29d-40d8-a087-0211040f014a","Type":"ContainerStarted","Data":"826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757"}
Sep 10 15:51:01.436651 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.436512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" event={"ID":"f7fe8f91-e29d-40d8-a087-0211040f014a","Type":"ContainerStarted","Data":"9d3717e91dedc27c3add7eb901a0ae6b126067f95905846a945992614f3b36b9"}
Sep 10 15:51:01.457089 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.457021    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podStartSLOduration=1.456998308 podStartE2EDuration="1.456998308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:51:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:51:01.455939671 +0000 UTC m=+1138.271015412" watchObservedRunningTime="2026-09-10 15:51:01.456998308 +0000 UTC m=+1138.272074079"
Sep 10 15:51:01.487100 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:01.487058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:02.042516 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:02.042472    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:02.043856 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:02.043820    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 10 15:51:02.044082 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:02.043889    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 10 15:51:03.053679 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:03.053643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:03.342164 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:03.342011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:03.444910 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:03.444876    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:03.451718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:03.451694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:03.455423 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:03.455402    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:03.759937 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:03.759899    2565 scope.go:117] "RemoveContainer" containerID="75f6d34d22dff8b54576fd0f4dd6a75d096741a731c9a35c7c973ddb20e332e6"
Sep 10 15:51:03.772291 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:03.772269    2565 scope.go:117] "RemoveContainer" containerID="e121db1e31ac47474e11b156bbad92063203e6aec99ce65c89998877c2dc050c"
Sep 10 15:51:04.494906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:04.494872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:04.594770 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:04.594727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:04.966986 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:04.966418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:05.063045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:05.063006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:05.140292 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:05.140254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:08.431158 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:08.431118    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:51:08.431568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:08.431196    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:51:09.508071 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:09.507994    2565 generic.go:356] "Generic (PLEG): container finished" podID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerID="73d59d80f2102d0787542fcb55ae3c030e7cda937c2e83d31ef1fda2d5ad87d1" exitCode=0
Sep 10 15:51:09.508450 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:09.508066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" event={"ID":"cdcf8b28-ba13-4672-814f-d092bc3d2565","Type":"ContainerDied","Data":"73d59d80f2102d0787542fcb55ae3c030e7cda937c2e83d31ef1fda2d5ad87d1"}
Sep 10 15:51:09.508493 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:09.508464    2565 scope.go:117] "RemoveContainer" containerID="73d59d80f2102d0787542fcb55ae3c030e7cda937c2e83d31ef1fda2d5ad87d1"
Sep 10 15:51:09.509638 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:09.509611    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:09.509694 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:09.509681    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:09.509731 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:09.509715    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:10.515254 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:10.515224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" event={"ID":"cdcf8b28-ba13-4672-814f-d092bc3d2565","Type":"ContainerStarted","Data":"2dcc07123de83962bc28ff04d07776ae3e3fda6beed30f0d9ecfa5b89fd038ec"}
Sep 10 15:51:11.001324 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:11.001290    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:51:11.001568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:11.001491    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 15:51:11.001568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:11.001533    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 15:51:11.249537 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:11.249498    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:51:12.001352 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:12.001314    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 15:51:12.001823 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:12.001378    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 15:51:13.001226 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:13.001194    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 15:51:13.001446 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:13.001426    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 15:51:14.001760 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:14.001719    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 15:51:14.002168 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:14.001775    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 15:51:15.000997 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:15.000940    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 10 15:51:15.001179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:15.001019    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 10 15:51:15.462939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:15.462889    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:16.200627 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:16.200594    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:51:16.200909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:16.200885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:51:16.201602 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:16.201584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:51:18.335764 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:18.335680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:19.017422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.017385    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8174-140672477300464"]
Sep 10 15:51:19.022109 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.022089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672477300464"
Sep 10 15:51:19.024930 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.024900    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tpk2l\""
Sep 10 15:51:19.027423 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.027392    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672477300464"]
Sep 10 15:51:19.052850 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.052819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjx6g\" (UniqueName: \"kubernetes.io/projected/6729db50-4d68-4f24-a0b0-86dfcc56be89-kube-api-access-vjx6g\") pod \"test-curl-8174-140672477300464\" (UID: \"6729db50-4d68-4f24-a0b0-86dfcc56be89\") " pod="opendatahub/test-curl-8174-140672477300464"
Sep 10 15:51:19.153515 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.153461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjx6g\" (UniqueName: \"kubernetes.io/projected/6729db50-4d68-4f24-a0b0-86dfcc56be89-kube-api-access-vjx6g\") pod \"test-curl-8174-140672477300464\" (UID: \"6729db50-4d68-4f24-a0b0-86dfcc56be89\") " pod="opendatahub/test-curl-8174-140672477300464"
Sep 10 15:51:19.162063 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.162027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjx6g\" (UniqueName: \"kubernetes.io/projected/6729db50-4d68-4f24-a0b0-86dfcc56be89-kube-api-access-vjx6g\") pod \"test-curl-8174-140672477300464\" (UID: \"6729db50-4d68-4f24-a0b0-86dfcc56be89\") " pod="opendatahub/test-curl-8174-140672477300464"
Sep 10 15:51:19.334007 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.333905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672477300464"
Sep 10 15:51:19.494172 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.494126    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:51:19.494549 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.494212    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:51:19.606968 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:19.606927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672477300464"]
Sep 10 15:51:19.607710 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:19.607683    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6729db50_4d68_4f24_a0b0_86dfcc56be89.slice/crio-bfec51cd13f82f3bb6b6ef85585366228ba9aaea81b6d698a7c562e0c621d251 WatchSource:0}: Error finding container bfec51cd13f82f3bb6b6ef85585366228ba9aaea81b6d698a7c562e0c621d251: Status 404 returned error can't find the container with id bfec51cd13f82f3bb6b6ef85585366228ba9aaea81b6d698a7c562e0c621d251
Sep 10 15:51:20.576005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:20.575955    2565 generic.go:356] "Generic (PLEG): container finished" podID="6729db50-4d68-4f24-a0b0-86dfcc56be89" containerID="271e7a42444d7a7b8e78d5e24e0a396e956bbe2a121a538ab5893b606ac1b60d" exitCode=0
Sep 10 15:51:20.576372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:20.576004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672477300464" event={"ID":"6729db50-4d68-4f24-a0b0-86dfcc56be89","Type":"ContainerDied","Data":"271e7a42444d7a7b8e78d5e24e0a396e956bbe2a121a538ab5893b606ac1b60d"}
Sep 10 15:51:20.576372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:20.576049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672477300464" event={"ID":"6729db50-4d68-4f24-a0b0-86dfcc56be89","Type":"ContainerStarted","Data":"bfec51cd13f82f3bb6b6ef85585366228ba9aaea81b6d698a7c562e0c621d251"}
Sep 10 15:51:21.583182 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.583149    2565 generic.go:356] "Generic (PLEG): container finished" podID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerID="826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757" exitCode=0
Sep 10 15:51:21.583624 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.583222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" event={"ID":"f7fe8f91-e29d-40d8-a087-0211040f014a","Type":"ContainerDied","Data":"826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757"}
Sep 10 15:51:21.584059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.583760    2565 scope.go:117] "RemoveContainer" containerID="826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757"
Sep 10 15:51:21.584854 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.584823    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:21.584978 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.584895    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:21.584978 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.584926    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:21.737044 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.737013    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672477300464"
Sep 10 15:51:21.755646 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.755614    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8174-140672477300464_6729db50-4d68-4f24-a0b0-86dfcc56be89/test-curl-8174-140672477300464/0.log"
Sep 10 15:51:21.776510 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.776477    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8174-140672477300464"]
Sep 10 15:51:21.780669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.780633    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8174-140672477300464"]
Sep 10 15:51:21.780669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.780661    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjx6g\" (UniqueName: \"kubernetes.io/projected/6729db50-4d68-4f24-a0b0-86dfcc56be89-kube-api-access-vjx6g\") pod \"6729db50-4d68-4f24-a0b0-86dfcc56be89\" (UID: \"6729db50-4d68-4f24-a0b0-86dfcc56be89\") "
Sep 10 15:51:21.782785 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.782756    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6729db50-4d68-4f24-a0b0-86dfcc56be89-kube-api-access-vjx6g" (OuterVolumeSpecName: "kube-api-access-vjx6g") pod "6729db50-4d68-4f24-a0b0-86dfcc56be89" (UID: "6729db50-4d68-4f24-a0b0-86dfcc56be89"). InnerVolumeSpecName "kube-api-access-vjx6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:51:21.825908 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.825878    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6729db50-4d68-4f24-a0b0-86dfcc56be89" path="/var/lib/kubelet/pods/6729db50-4d68-4f24-a0b0-86dfcc56be89/volumes"
Sep 10 15:51:21.881855 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.881815    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjx6g\" (UniqueName: \"kubernetes.io/projected/6729db50-4d68-4f24-a0b0-86dfcc56be89-kube-api-access-vjx6g\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:51:21.939552 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.939524    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8174-140672475562896"]
Sep 10 15:51:21.939929 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.939914    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6729db50-4d68-4f24-a0b0-86dfcc56be89" containerName="test-curl-8174-140672477300464"
Sep 10 15:51:21.940038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.939931    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6729db50-4d68-4f24-a0b0-86dfcc56be89" containerName="test-curl-8174-140672477300464"
Sep 10 15:51:21.940038 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.940023    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6729db50-4d68-4f24-a0b0-86dfcc56be89" containerName="test-curl-8174-140672477300464"
Sep 10 15:51:21.943057 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.943041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:21.950290 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.950148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672475562896"]
Sep 10 15:51:21.982496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:21.982467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs7vs\" (UniqueName: \"kubernetes.io/projected/25cb9c57-d1a2-42a9-ab44-94b720b5b837-kube-api-access-qs7vs\") pod \"test-curl-8174-140672475562896\" (UID: \"25cb9c57-d1a2-42a9-ab44-94b720b5b837\") " pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:22.083996 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:22.083856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs7vs\" (UniqueName: \"kubernetes.io/projected/25cb9c57-d1a2-42a9-ab44-94b720b5b837-kube-api-access-qs7vs\") pod \"test-curl-8174-140672475562896\" (UID: \"25cb9c57-d1a2-42a9-ab44-94b720b5b837\") " pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:22.091978 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:22.091930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs7vs\" (UniqueName: \"kubernetes.io/projected/25cb9c57-d1a2-42a9-ab44-94b720b5b837-kube-api-access-qs7vs\") pod \"test-curl-8174-140672475562896\" (UID: \"25cb9c57-d1a2-42a9-ab44-94b720b5b837\") " pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:22.252915 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:22.252869    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:22.527751 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:22.527721    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672475562896"]
Sep 10 15:51:22.530119 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:22.530090    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25cb9c57_d1a2_42a9_ab44_94b720b5b837.slice/crio-5d159ca4c59d2461c8c631145718ea3b9a603b89d092e9c1477a00b9bea6d86b WatchSource:0}: Error finding container 5d159ca4c59d2461c8c631145718ea3b9a603b89d092e9c1477a00b9bea6d86b: Status 404 returned error can't find the container with id 5d159ca4c59d2461c8c631145718ea3b9a603b89d092e9c1477a00b9bea6d86b
Sep 10 15:51:22.589731 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:22.589688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672475562896" event={"ID":"25cb9c57-d1a2-42a9-ab44-94b720b5b837","Type":"ContainerStarted","Data":"5d159ca4c59d2461c8c631145718ea3b9a603b89d092e9c1477a00b9bea6d86b"}
Sep 10 15:51:22.591738 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:22.591712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" event={"ID":"f7fe8f91-e29d-40d8-a087-0211040f014a","Type":"ContainerStarted","Data":"029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e"}
Sep 10 15:51:22.592916 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:22.592896    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672477300464"
Sep 10 15:51:22.593078 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:22.592932    2565 scope.go:117] "RemoveContainer" containerID="271e7a42444d7a7b8e78d5e24e0a396e956bbe2a121a538ab5893b606ac1b60d"
Sep 10 15:51:23.043357 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:23.043320    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:23.043715 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:23.043621    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 10 15:51:23.043940 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:23.043914    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 10 15:51:24.046385 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:24.046347    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 10 15:51:24.046889 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:24.046416    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 10 15:51:24.606016 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:24.605982    2565 generic.go:356] "Generic (PLEG): container finished" podID="25cb9c57-d1a2-42a9-ab44-94b720b5b837" containerID="5aad9d669a83509cf0a0feb10aad5f38e811d1269372184289e856eb8e764c03" exitCode=0
Sep 10 15:51:24.606215 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:24.606067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672475562896" event={"ID":"25cb9c57-d1a2-42a9-ab44-94b720b5b837","Type":"ContainerDied","Data":"5aad9d669a83509cf0a0feb10aad5f38e811d1269372184289e856eb8e764c03"}
Sep 10 15:51:25.043501 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.043455    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 10 15:51:25.043726 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.043532    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 10 15:51:25.348006 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.347887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:25.810653 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.810625    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:25.833986 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.833923    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8174-140672475562896_25cb9c57-d1a2-42a9-ab44-94b720b5b837/test-curl-8174-140672475562896/0.log"
Sep 10 15:51:25.870221 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.870116    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8174-140672475562896"]
Sep 10 15:51:25.873242 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.873210    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8174-140672475562896"]
Sep 10 15:51:25.928567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.928532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs7vs\" (UniqueName: \"kubernetes.io/projected/25cb9c57-d1a2-42a9-ab44-94b720b5b837-kube-api-access-qs7vs\") pod \"25cb9c57-d1a2-42a9-ab44-94b720b5b837\" (UID: \"25cb9c57-d1a2-42a9-ab44-94b720b5b837\") "
Sep 10 15:51:25.930671 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:25.930637    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25cb9c57-d1a2-42a9-ab44-94b720b5b837-kube-api-access-qs7vs" (OuterVolumeSpecName: "kube-api-access-qs7vs") pod "25cb9c57-d1a2-42a9-ab44-94b720b5b837" (UID: "25cb9c57-d1a2-42a9-ab44-94b720b5b837"). InnerVolumeSpecName "kube-api-access-qs7vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:51:26.001032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.000989    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:26.001392 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.001378    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25cb9c57-d1a2-42a9-ab44-94b720b5b837" containerName="test-curl-8174-140672475562896"
Sep 10 15:51:26.001440 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.001393    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25cb9c57-d1a2-42a9-ab44-94b720b5b837" containerName="test-curl-8174-140672475562896"
Sep 10 15:51:26.001475 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.001470    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25cb9c57-d1a2-42a9-ab44-94b720b5b837" containerName="test-curl-8174-140672475562896"
Sep 10 15:51:26.004506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.004490    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:26.011049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.011024    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:26.029600 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.029578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4x8\" (UniqueName: \"kubernetes.io/projected/63b1322a-6e0b-4013-b570-f48fe5b57d31-kube-api-access-jz4x8\") pod \"test-curl-8174-140672474294576\" (UID: \"63b1322a-6e0b-4013-b570-f48fe5b57d31\") " pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:26.029735 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.029710    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs7vs\" (UniqueName: \"kubernetes.io/projected/25cb9c57-d1a2-42a9-ab44-94b720b5b837-kube-api-access-qs7vs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:51:26.046991 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.046334    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 10 15:51:26.046991 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.046392    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 10 15:51:26.131101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.130987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4x8\" (UniqueName: \"kubernetes.io/projected/63b1322a-6e0b-4013-b570-f48fe5b57d31-kube-api-access-jz4x8\") pod \"test-curl-8174-140672474294576\" (UID: \"63b1322a-6e0b-4013-b570-f48fe5b57d31\") " pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:26.139350 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.139320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4x8\" (UniqueName: \"kubernetes.io/projected/63b1322a-6e0b-4013-b570-f48fe5b57d31-kube-api-access-jz4x8\") pod \"test-curl-8174-140672474294576\" (UID: \"63b1322a-6e0b-4013-b570-f48fe5b57d31\") " pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:26.315254 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.315217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:26.607591 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.607551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:26.609815 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:26.609791    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63b1322a_6e0b_4013_b570_f48fe5b57d31.slice/crio-a5951252df001b0fff7efd762cb70a49a7e8f1d92589fc8ff508c7667585b8dc WatchSource:0}: Error finding container a5951252df001b0fff7efd762cb70a49a7e8f1d92589fc8ff508c7667585b8dc: Status 404 returned error can't find the container with id a5951252df001b0fff7efd762cb70a49a7e8f1d92589fc8ff508c7667585b8dc
Sep 10 15:51:26.616739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.616718    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:26.616835 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.616742    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d159ca4c59d2461c8c631145718ea3b9a603b89d092e9c1477a00b9bea6d86b"
Sep 10 15:51:26.617907 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:26.617886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672474294576" event={"ID":"63b1322a-6e0b-4013-b570-f48fe5b57d31","Type":"ContainerStarted","Data":"a5951252df001b0fff7efd762cb70a49a7e8f1d92589fc8ff508c7667585b8dc"}
Sep 10 15:51:26.627260 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:26.627235    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672475562896\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="25cb9c57-d1a2-42a9-ab44-94b720b5b837" pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:27.043275 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:27.042802    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 10 15:51:27.043275 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:27.042872    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 10 15:51:27.625568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:27.625528    2565 generic.go:356] "Generic (PLEG): container finished" podID="63b1322a-6e0b-4013-b570-f48fe5b57d31" containerID="a95398efa74eb58e32c296ebabe1432536c746389950aa6195560fced12187c9" exitCode=0
Sep 10 15:51:27.626012 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:27.625615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672474294576" event={"ID":"63b1322a-6e0b-4013-b570-f48fe5b57d31","Type":"ContainerDied","Data":"a95398efa74eb58e32c296ebabe1432536c746389950aa6195560fced12187c9"}
Sep 10 15:51:27.627530 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:27.627504    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672475562896\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="25cb9c57-d1a2-42a9-ab44-94b720b5b837" pod="opendatahub/test-curl-8174-140672475562896"
Sep 10 15:51:27.827650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:27.827613    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25cb9c57-d1a2-42a9-ab44-94b720b5b837" path="/var/lib/kubelet/pods/25cb9c57-d1a2-42a9-ab44-94b720b5b837/volumes"
Sep 10 15:51:28.046161 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.046133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:28.046440 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.046419    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:28.047045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.047027    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 15:51:28.317222 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.317129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:28.770241 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.770217    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:28.787816 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.787782    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8174-140672474294576_63b1322a-6e0b-4013-b570-f48fe5b57d31/test-curl-8174-140672474294576/0.log"
Sep 10 15:51:28.808845 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.808811    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:28.812007 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.811983    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:28.860520 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.860484    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz4x8\" (UniqueName: \"kubernetes.io/projected/63b1322a-6e0b-4013-b570-f48fe5b57d31-kube-api-access-jz4x8\") pod \"63b1322a-6e0b-4013-b570-f48fe5b57d31\" (UID: \"63b1322a-6e0b-4013-b570-f48fe5b57d31\") "
Sep 10 15:51:28.862578 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.862548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b1322a-6e0b-4013-b570-f48fe5b57d31-kube-api-access-jz4x8" (OuterVolumeSpecName: "kube-api-access-jz4x8") pod "63b1322a-6e0b-4013-b570-f48fe5b57d31" (UID: "63b1322a-6e0b-4013-b570-f48fe5b57d31"). InnerVolumeSpecName "kube-api-access-jz4x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:51:28.932945 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.932909    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:28.933414 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.933383    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b1322a-6e0b-4013-b570-f48fe5b57d31" containerName="test-curl-8174-140672474294576"
Sep 10 15:51:28.933414 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.933406    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b1322a-6e0b-4013-b570-f48fe5b57d31" containerName="test-curl-8174-140672474294576"
Sep 10 15:51:28.933554 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.933505    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b1322a-6e0b-4013-b570-f48fe5b57d31" containerName="test-curl-8174-140672474294576"
Sep 10 15:51:28.936472 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.936453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:28.947975 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.943922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:28.961675 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:28.961646    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz4x8\" (UniqueName: \"kubernetes.io/projected/63b1322a-6e0b-4013-b570-f48fe5b57d31-kube-api-access-jz4x8\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:51:29.062825 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.062790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhbb\" (UniqueName: \"kubernetes.io/projected/6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4-kube-api-access-5rhbb\") pod \"test-curl-8174-140672474294576\" (UID: \"6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4\") " pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:29.164062 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.164029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhbb\" (UniqueName: \"kubernetes.io/projected/6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4-kube-api-access-5rhbb\") pod \"test-curl-8174-140672474294576\" (UID: \"6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4\") " pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:29.172207 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.172178    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhbb\" (UniqueName: \"kubernetes.io/projected/6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4-kube-api-access-5rhbb\") pod \"test-curl-8174-140672474294576\" (UID: \"6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4\") " pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:29.253616 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.253531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:29.524721 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.524695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:29.527029 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:29.527002    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d5f6628_37aa_4a2e_89b1_e96f0fdcdcc4.slice/crio-69a4f40ab1dc7f8eec811fd963ef01e8e4c95ac23372003094be58798d6f7ddf WatchSource:0}: Error finding container 69a4f40ab1dc7f8eec811fd963ef01e8e4c95ac23372003094be58798d6f7ddf: Status 404 returned error can't find the container with id 69a4f40ab1dc7f8eec811fd963ef01e8e4c95ac23372003094be58798d6f7ddf
Sep 10 15:51:29.637664 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.637632    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5951252df001b0fff7efd762cb70a49a7e8f1d92589fc8ff508c7667585b8dc"
Sep 10 15:51:29.637664 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.637642    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:29.639017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.638984    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672474294576" event={"ID":"6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4","Type":"ContainerStarted","Data":"69a4f40ab1dc7f8eec811fd963ef01e8e4c95ac23372003094be58798d6f7ddf"}
Sep 10 15:51:29.649451 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.649426    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-8174-140672474294576" oldPodUID="63b1322a-6e0b-4013-b570-f48fe5b57d31" podUID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4"
Sep 10 15:51:29.824487 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:29.824398    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63b1322a-6e0b-4013-b570-f48fe5b57d31" path="/var/lib/kubelet/pods/63b1322a-6e0b-4013-b570-f48fe5b57d31/volumes"
Sep 10 15:51:30.646364 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:30.646332    2565 generic.go:356] "Generic (PLEG): container finished" podID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" containerID="7b21e51facb3ed06c0a171aa912a1ff41a0c4ddfa848336e096ec7ddfb76405f" exitCode=0
Sep 10 15:51:30.646550 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:30.646424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672474294576" event={"ID":"6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4","Type":"ContainerDied","Data":"7b21e51facb3ed06c0a171aa912a1ff41a0c4ddfa848336e096ec7ddfb76405f"}
Sep 10 15:51:31.790010 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.789984    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:31.808083 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.808058    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8174-140672474294576_6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4/test-curl-8174-140672474294576/0.log"
Sep 10 15:51:31.829138 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.829109    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:31.834631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.834607    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8174-140672474294576"]
Sep 10 15:51:31.892348 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.892315    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rhbb\" (UniqueName: \"kubernetes.io/projected/6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4-kube-api-access-5rhbb\") pod \"6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4\" (UID: \"6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4\") "
Sep 10 15:51:31.894419 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.894392    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4-kube-api-access-5rhbb" (OuterVolumeSpecName: "kube-api-access-5rhbb") pod "6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" (UID: "6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4"). InnerVolumeSpecName "kube-api-access-5rhbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:51:31.954655 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.954575    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:31.954999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.954985    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" containerName="test-curl-8174-140672474294576"
Sep 10 15:51:31.955062 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.955001    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" containerName="test-curl-8174-140672474294576"
Sep 10 15:51:31.955100 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.955080    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" containerName="test-curl-8174-140672474294576"
Sep 10 15:51:31.958037 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.958021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:31.965153 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.965123    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:31.993201 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:31.993167    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rhbb\" (UniqueName: \"kubernetes.io/projected/6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4-kube-api-access-5rhbb\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:51:32.094591 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:32.094547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdq9\" (UniqueName: \"kubernetes.io/projected/71d06762-bf92-49bf-ae93-47d444617b8b-kube-api-access-hrdq9\") pod \"test-curl-8174-140672478664144\" (UID: \"71d06762-bf92-49bf-ae93-47d444617b8b\") " pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:32.196122 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:32.196076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdq9\" (UniqueName: \"kubernetes.io/projected/71d06762-bf92-49bf-ae93-47d444617b8b-kube-api-access-hrdq9\") pod \"test-curl-8174-140672478664144\" (UID: \"71d06762-bf92-49bf-ae93-47d444617b8b\") " pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:32.205390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:32.205317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdq9\" (UniqueName: \"kubernetes.io/projected/71d06762-bf92-49bf-ae93-47d444617b8b-kube-api-access-hrdq9\") pod \"test-curl-8174-140672478664144\" (UID: \"71d06762-bf92-49bf-ae93-47d444617b8b\") " pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:32.268830 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:32.268782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:32.539351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:32.539327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:32.541548 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:32.541513    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71d06762_bf92_49bf_ae93_47d444617b8b.slice/crio-1697ff5ccadfcdbe5d13643fc958212669b6de2300bf9a13649b487fdb308461 WatchSource:0}: Error finding container 1697ff5ccadfcdbe5d13643fc958212669b6de2300bf9a13649b487fdb308461: Status 404 returned error can't find the container with id 1697ff5ccadfcdbe5d13643fc958212669b6de2300bf9a13649b487fdb308461
Sep 10 15:51:32.657950 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:32.657909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672478664144" event={"ID":"71d06762-bf92-49bf-ae93-47d444617b8b","Type":"ContainerStarted","Data":"1697ff5ccadfcdbe5d13643fc958212669b6de2300bf9a13649b487fdb308461"}
Sep 10 15:51:32.659195 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:32.659172    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69a4f40ab1dc7f8eec811fd963ef01e8e4c95ac23372003094be58798d6f7ddf"
Sep 10 15:51:32.659337 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:32.659205    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:32.669759 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:32.669731    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672474294576\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:33.668571 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:33.668532    2565 generic.go:356] "Generic (PLEG): container finished" podID="71d06762-bf92-49bf-ae93-47d444617b8b" containerID="17f06798d7e0a145259b7d105ce1c4601ae86a0c754b48a739cfecb2c7d9d0bd" exitCode=0
Sep 10 15:51:33.668954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:33.668616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672478664144" event={"ID":"71d06762-bf92-49bf-ae93-47d444617b8b","Type":"ContainerDied","Data":"17f06798d7e0a145259b7d105ce1c4601ae86a0c754b48a739cfecb2c7d9d0bd"}
Sep 10 15:51:33.670806 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:33.670770    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672474294576\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:33.828833 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:33.828788    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672474294576\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" pod="opendatahub/test-curl-8174-140672474294576"
Sep 10 15:51:33.831235 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:33.831206    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4" path="/var/lib/kubelet/pods/6d5f6628-37aa-4a2e-89b1-e96f0fdcdcc4/volumes"
Sep 10 15:51:34.808277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.808250    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:34.826150 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.826110    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8174-140672478664144_71d06762-bf92-49bf-ae93-47d444617b8b/test-curl-8174-140672478664144/0.log"
Sep 10 15:51:34.846430 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.846397    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:34.851503 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.851475    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:34.924627 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.924537    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrdq9\" (UniqueName: \"kubernetes.io/projected/71d06762-bf92-49bf-ae93-47d444617b8b-kube-api-access-hrdq9\") pod \"71d06762-bf92-49bf-ae93-47d444617b8b\" (UID: \"71d06762-bf92-49bf-ae93-47d444617b8b\") "
Sep 10 15:51:34.926645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.926618    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d06762-bf92-49bf-ae93-47d444617b8b-kube-api-access-hrdq9" (OuterVolumeSpecName: "kube-api-access-hrdq9") pod "71d06762-bf92-49bf-ae93-47d444617b8b" (UID: "71d06762-bf92-49bf-ae93-47d444617b8b"). InnerVolumeSpecName "kube-api-access-hrdq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:51:34.968380 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.968348    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:34.968826 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.968806    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d06762-bf92-49bf-ae93-47d444617b8b" containerName="test-curl-8174-140672478664144"
Sep 10 15:51:34.968912 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.968828    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d06762-bf92-49bf-ae93-47d444617b8b" containerName="test-curl-8174-140672478664144"
Sep 10 15:51:34.968991 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.968916    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d06762-bf92-49bf-ae93-47d444617b8b" containerName="test-curl-8174-140672478664144"
Sep 10 15:51:34.972043 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.972022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:34.975788 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:34.975760    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:35.026148 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.026116    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrdq9\" (UniqueName: \"kubernetes.io/projected/71d06762-bf92-49bf-ae93-47d444617b8b-kube-api-access-hrdq9\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:51:35.127381 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.127344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95rr9\" (UniqueName: \"kubernetes.io/projected/6f2f2791-b8a0-4221-a2b5-3465c66f78fe-kube-api-access-95rr9\") pod \"test-curl-8174-140672478664144\" (UID: \"6f2f2791-b8a0-4221-a2b5-3465c66f78fe\") " pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:35.228529 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.228413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95rr9\" (UniqueName: \"kubernetes.io/projected/6f2f2791-b8a0-4221-a2b5-3465c66f78fe-kube-api-access-95rr9\") pod \"test-curl-8174-140672478664144\" (UID: \"6f2f2791-b8a0-4221-a2b5-3465c66f78fe\") " pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:35.237311 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.237235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95rr9\" (UniqueName: \"kubernetes.io/projected/6f2f2791-b8a0-4221-a2b5-3465c66f78fe-kube-api-access-95rr9\") pod \"test-curl-8174-140672478664144\" (UID: \"6f2f2791-b8a0-4221-a2b5-3465c66f78fe\") " pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:35.282935 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.282898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:35.554121 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.554092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:35.556003 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:35.555976    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f2f2791_b8a0_4221_a2b5_3465c66f78fe.slice/crio-02792ba410bad061810572ee399c55941651649d11328fc07b39ff2356ba3b3c WatchSource:0}: Error finding container 02792ba410bad061810572ee399c55941651649d11328fc07b39ff2356ba3b3c: Status 404 returned error can't find the container with id 02792ba410bad061810572ee399c55941651649d11328fc07b39ff2356ba3b3c
Sep 10 15:51:35.681529 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.681496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672478664144" event={"ID":"6f2f2791-b8a0-4221-a2b5-3465c66f78fe","Type":"ContainerStarted","Data":"02792ba410bad061810572ee399c55941651649d11328fc07b39ff2356ba3b3c"}
Sep 10 15:51:35.682761 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.682742    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1697ff5ccadfcdbe5d13643fc958212669b6de2300bf9a13649b487fdb308461"
Sep 10 15:51:35.682886 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.682771    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:35.694562 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.694537    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-8174-140672478664144" oldPodUID="71d06762-bf92-49bf-ae93-47d444617b8b" podUID="6f2f2791-b8a0-4221-a2b5-3465c66f78fe"
Sep 10 15:51:35.824740 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:35.824661    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71d06762-bf92-49bf-ae93-47d444617b8b" path="/var/lib/kubelet/pods/71d06762-bf92-49bf-ae93-47d444617b8b/volumes"
Sep 10 15:51:36.689225 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:36.689186    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f2f2791-b8a0-4221-a2b5-3465c66f78fe" containerID="b6dd446341a056c04eae46b57b1c6abcd5940f424d6cb686e303a276bc716cf8" exitCode=0
Sep 10 15:51:36.689411 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:36.689258    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672478664144" event={"ID":"6f2f2791-b8a0-4221-a2b5-3465c66f78fe","Type":"ContainerDied","Data":"b6dd446341a056c04eae46b57b1c6abcd5940f424d6cb686e303a276bc716cf8"}
Sep 10 15:51:37.829308 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:37.829280    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:37.849237 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:37.849202    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8174-140672478664144_6f2f2791-b8a0-4221-a2b5-3465c66f78fe/test-curl-8174-140672478664144/0.log"
Sep 10 15:51:37.874316 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:37.874281    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:37.878661 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:37.878634    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8174-140672478664144"]
Sep 10 15:51:37.952779 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:37.952698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95rr9\" (UniqueName: \"kubernetes.io/projected/6f2f2791-b8a0-4221-a2b5-3465c66f78fe-kube-api-access-95rr9\") pod \"6f2f2791-b8a0-4221-a2b5-3465c66f78fe\" (UID: \"6f2f2791-b8a0-4221-a2b5-3465c66f78fe\") "
Sep 10 15:51:37.954784 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:37.954751    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2f2791-b8a0-4221-a2b5-3465c66f78fe-kube-api-access-95rr9" (OuterVolumeSpecName: "kube-api-access-95rr9") pod "6f2f2791-b8a0-4221-a2b5-3465c66f78fe" (UID: "6f2f2791-b8a0-4221-a2b5-3465c66f78fe"). InnerVolumeSpecName "kube-api-access-95rr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:51:38.005118 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.005085    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8174-140672478663280"]
Sep 10 15:51:38.005495 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.005483    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2f2791-b8a0-4221-a2b5-3465c66f78fe" containerName="test-curl-8174-140672478664144"
Sep 10 15:51:38.005553 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.005497    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2f2791-b8a0-4221-a2b5-3465c66f78fe" containerName="test-curl-8174-140672478664144"
Sep 10 15:51:38.005591 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.005569    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f2f2791-b8a0-4221-a2b5-3465c66f78fe" containerName="test-curl-8174-140672478664144"
Sep 10 15:51:38.008657 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.008640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:38.015016 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.014989    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672478663280"]
Sep 10 15:51:38.053813 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.053780    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95rr9\" (UniqueName: \"kubernetes.io/projected/6f2f2791-b8a0-4221-a2b5-3465c66f78fe-kube-api-access-95rr9\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:51:38.155306 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.155267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t46gx\" (UniqueName: \"kubernetes.io/projected/7707d101-9c0b-47b3-adc0-bbb0036ef273-kube-api-access-t46gx\") pod \"test-curl-8174-140672478663280\" (UID: \"7707d101-9c0b-47b3-adc0-bbb0036ef273\") " pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:38.256824 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.256726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t46gx\" (UniqueName: \"kubernetes.io/projected/7707d101-9c0b-47b3-adc0-bbb0036ef273-kube-api-access-t46gx\") pod \"test-curl-8174-140672478663280\" (UID: \"7707d101-9c0b-47b3-adc0-bbb0036ef273\") " pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:38.264925 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.264899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46gx\" (UniqueName: \"kubernetes.io/projected/7707d101-9c0b-47b3-adc0-bbb0036ef273-kube-api-access-t46gx\") pod \"test-curl-8174-140672478663280\" (UID: \"7707d101-9c0b-47b3-adc0-bbb0036ef273\") " pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:38.318138 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.318095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:38.592169 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.592142    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8174-140672478663280"]
Sep 10 15:51:38.594221 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:38.594194    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7707d101_9c0b_47b3_adc0_bbb0036ef273.slice/crio-3fb331209ce4030238fc8a91c982d1ad03b48bf245fc322c92133bcb5dc4f1d1 WatchSource:0}: Error finding container 3fb331209ce4030238fc8a91c982d1ad03b48bf245fc322c92133bcb5dc4f1d1: Status 404 returned error can't find the container with id 3fb331209ce4030238fc8a91c982d1ad03b48bf245fc322c92133bcb5dc4f1d1
Sep 10 15:51:38.701762 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.701720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672478663280" event={"ID":"7707d101-9c0b-47b3-adc0-bbb0036ef273","Type":"ContainerStarted","Data":"3fb331209ce4030238fc8a91c982d1ad03b48bf245fc322c92133bcb5dc4f1d1"}
Sep 10 15:51:38.703014 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.702988    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02792ba410bad061810572ee399c55941651649d11328fc07b39ff2356ba3b3c"
Sep 10 15:51:38.703014 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:38.703010    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:38.713396 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:38.713366    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672478664144\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="6f2f2791-b8a0-4221-a2b5-3465c66f78fe" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:39.709861 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:39.709823    2565 generic.go:356] "Generic (PLEG): container finished" podID="7707d101-9c0b-47b3-adc0-bbb0036ef273" containerID="a64c868419d517f1b18f24d8b9f8f79fcd39b47b0e012f65eb7202446bd0b3e3" exitCode=0
Sep 10 15:51:39.710321 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:39.709909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8174-140672478663280" event={"ID":"7707d101-9c0b-47b3-adc0-bbb0036ef273","Type":"ContainerDied","Data":"a64c868419d517f1b18f24d8b9f8f79fcd39b47b0e012f65eb7202446bd0b3e3"}
Sep 10 15:51:39.726119 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:39.726079    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672478664144\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="6f2f2791-b8a0-4221-a2b5-3465c66f78fe" pod="opendatahub/test-curl-8174-140672478664144"
Sep 10 15:51:39.824382 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:39.824343    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f2f2791-b8a0-4221-a2b5-3465c66f78fe" path="/var/lib/kubelet/pods/6f2f2791-b8a0-4221-a2b5-3465c66f78fe/volumes"
Sep 10 15:51:39.980307 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:39.980215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:40.850244 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:40.850214    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:40.870133 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:40.870102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8174-140672478663280_7707d101-9c0b-47b3-adc0-bbb0036ef273/test-curl-8174-140672478663280/0.log"
Sep 10 15:51:40.891538 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:40.891509    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8174-140672478663280"]
Sep 10 15:51:40.893287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:40.893266    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8174-140672478663280"]
Sep 10 15:51:40.985857 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:40.985774    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t46gx\" (UniqueName: \"kubernetes.io/projected/7707d101-9c0b-47b3-adc0-bbb0036ef273-kube-api-access-t46gx\") pod \"7707d101-9c0b-47b3-adc0-bbb0036ef273\" (UID: \"7707d101-9c0b-47b3-adc0-bbb0036ef273\") "
Sep 10 15:51:40.988072 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:40.988040    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7707d101-9c0b-47b3-adc0-bbb0036ef273-kube-api-access-t46gx" (OuterVolumeSpecName: "kube-api-access-t46gx") pod "7707d101-9c0b-47b3-adc0-bbb0036ef273" (UID: "7707d101-9c0b-47b3-adc0-bbb0036ef273"). InnerVolumeSpecName "kube-api-access-t46gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:51:41.086790 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.086751    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t46gx\" (UniqueName: \"kubernetes.io/projected/7707d101-9c0b-47b3-adc0-bbb0036ef273-kube-api-access-t46gx\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:51:41.529233 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.529189    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:41.722625 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.722593    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:41.722919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.722595    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fb331209ce4030238fc8a91c982d1ad03b48bf245fc322c92133bcb5dc4f1d1"
Sep 10 15:51:41.737485 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:41.737453    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672478663280\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="7707d101-9c0b-47b3-adc0-bbb0036ef273" pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:41.804947 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.804862    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"]
Sep 10 15:51:41.805540 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.805520    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7707d101-9c0b-47b3-adc0-bbb0036ef273" containerName="test-curl-8174-140672478663280"
Sep 10 15:51:41.805601 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.805543    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7707d101-9c0b-47b3-adc0-bbb0036ef273" containerName="test-curl-8174-140672478663280"
Sep 10 15:51:41.805672 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.805643    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7707d101-9c0b-47b3-adc0-bbb0036ef273" containerName="test-curl-8174-140672478663280"
Sep 10 15:51:41.809003 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.808981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.811265 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:51:41.811234    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8174-140672478663280\" is forbidden: User \"system:node:ip-10-0-136-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-122.ec2.internal' and this object" podUID="7707d101-9c0b-47b3-adc0-bbb0036ef273" pod="opendatahub/test-curl-8174-140672478663280"
Sep 10 15:51:41.811406 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.811389    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c1384d3d-openshift-default-dockercfg-tdbrj\""
Sep 10 15:51:41.825332 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.825304    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7707d101-9c0b-47b3-adc0-bbb0036ef273" path="/var/lib/kubelet/pods/7707d101-9c0b-47b3-adc0-bbb0036ef273/volumes"
Sep 10 15:51:41.825584 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.825572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"]
Sep 10 15:51:41.827445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.827415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:41.895393 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-credential-socket\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.895911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64bjc\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-kube-api-access-64bjc\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.895911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-certs\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.895911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-data\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.895911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-socket\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.895911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3af30544-447f-456c-ab39-0b5c50bed28a-istiod-ca-cert\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.895911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-istio-token\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.895911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3af30544-447f-456c-ab39-0b5c50bed28a-istio-podinfo\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.895911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.895753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-envoy\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.941591 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.941552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:41.996447 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64bjc\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-kube-api-access-64bjc\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.996637 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-certs\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.996637 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-data\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.996637 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-socket\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.996637 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3af30544-447f-456c-ab39-0b5c50bed28a-istiod-ca-cert\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.996637 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-istio-token\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.996918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3af30544-447f-456c-ab39-0b5c50bed28a-istio-podinfo\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.996918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-envoy\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.996918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-certs\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.997119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.996948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-credential-socket\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.997119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.997035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-socket\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.997265 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.997238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-credential-socket\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.997396 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.997297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3af30544-447f-456c-ab39-0b5c50bed28a-istiod-ca-cert\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.997396 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.997317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-data\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.999105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.999083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-envoy\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:41.999409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:41.999385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3af30544-447f-456c-ab39-0b5c50bed28a-istio-podinfo\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:42.005654 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.005625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-istio-token\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:42.006101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.006071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64bjc\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-kube-api-access-64bjc\") pod \"e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") " pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:42.120970 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.120862    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:42.396846 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.396814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"]
Sep 10 15:51:42.398566 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:51:42.398525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af30544_447f_456c_ab39_0b5c50bed28a.slice/crio-3748c301afa70e7726989759a442db048f6dd167ab122ae0b8dd6d9a82271fbe WatchSource:0}: Error finding container 3748c301afa70e7726989759a442db048f6dd167ab122ae0b8dd6d9a82271fbe: Status 404 returned error can't find the container with id 3748c301afa70e7726989759a442db048f6dd167ab122ae0b8dd6d9a82271fbe
Sep 10 15:51:42.401050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.401008    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:42.401129 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.401087    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:42.401129 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.401119    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:51:42.735050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.735014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" event={"ID":"3af30544-447f-456c-ab39-0b5c50bed28a","Type":"ContainerStarted","Data":"8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc"}
Sep 10 15:51:42.735247 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.735072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" event={"ID":"3af30544-447f-456c-ab39-0b5c50bed28a","Type":"ContainerStarted","Data":"3748c301afa70e7726989759a442db048f6dd167ab122ae0b8dd6d9a82271fbe"}
Sep 10 15:51:42.753305 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:42.753252    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" podStartSLOduration=1.753230373 podStartE2EDuration="1.753230373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:51:42.751093045 +0000 UTC m=+1179.566168785" watchObservedRunningTime="2026-09-10 15:51:42.753230373 +0000 UTC m=+1179.568306115"
Sep 10 15:51:43.121476 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:43.121375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:43.126842 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:43.126814    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:43.740735 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:43.740694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:43.741643 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:43.741624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:51:44.679593 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:44.679560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:44.824920 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:44.824883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:45.155793 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:45.155751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:51:45.912254 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:45.912220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:46.012325 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:46.012286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:46.116807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:46.116772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:46.364831 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:46.364743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:46.467417 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:46.467383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:51:59.860519 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:51:59.860461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:52:02.725128 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:02.725091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:52:03.714634 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.714543    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:52:03.716974 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.716932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:52:03.808256 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.808223    2565 scope.go:117] "RemoveContainer" containerID="1b135d8746161407ef6ae1af3c2be0f46ee812f5227a10d7a09682b558807af5"
Sep 10 15:52:03.816716 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.816699    2565 scope.go:117] "RemoveContainer" containerID="5c99ef6318098f4413b017b6d385baf13941c7c0676717b78e373027c46be123"
Sep 10 15:52:03.851142 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.851116    2565 generic.go:356] "Generic (PLEG): container finished" podID="3af30544-447f-456c-ab39-0b5c50bed28a" containerID="8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc" exitCode=0
Sep 10 15:52:03.851248 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.851189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" event={"ID":"3af30544-447f-456c-ab39-0b5c50bed28a","Type":"ContainerDied","Data":"8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc"}
Sep 10 15:52:03.851640 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.851625    2565 scope.go:117] "RemoveContainer" containerID="8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc"
Sep 10 15:52:03.852744 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.852713    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:52:03.852841 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.852779    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:52:03.852841 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:03.852812    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:52:04.863823 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:04.863774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" event={"ID":"3af30544-447f-456c-ab39-0b5c50bed28a","Type":"ContainerStarted","Data":"b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89"}
Sep 10 15:52:05.121997 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:05.121876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:52:05.122155 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:05.122127    2565 patch_prober.go:28] interesting pod/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:52:05.122201 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:05.122177    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 10 15:52:05.347593 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:05.347550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:52:06.122023 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.121951    2565 patch_prober.go:28] interesting pod/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:52:06.122459 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.122042    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 10 15:52:06.848694 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.848648    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"]
Sep 10 15:52:06.862610 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.854200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:06.862610 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.862252    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"kube-root-ca.crt\""
Sep 10 15:52:06.862610 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.862488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"default-dockercfg-67h76\""
Sep 10 15:52:06.862916 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.862893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"]
Sep 10 15:52:06.870059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.862952    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"auth-test-model-e412c4-kserve-self-signed-certs\""
Sep 10 15:52:06.870059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.863216    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"openshift-service-ca.crt\""
Sep 10 15:52:06.887228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.887200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:52:06.964568 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.964515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-home\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:06.965019 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.964990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8s4v\" (UniqueName: \"kubernetes.io/projected/04d43498-14de-43f8-aa74-745aeba5f2fe-kube-api-access-m8s4v\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:06.965212 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.965193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d43498-14de-43f8-aa74-745aeba5f2fe-tls-certs\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:06.965346 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.965331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-tmp-dir\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:06.965463 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.965446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-model-cache\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:06.965570 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:06.965557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-dshm\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.066857 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.066812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8s4v\" (UniqueName: \"kubernetes.io/projected/04d43498-14de-43f8-aa74-745aeba5f2fe-kube-api-access-m8s4v\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.067150 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.067111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d43498-14de-43f8-aa74-745aeba5f2fe-tls-certs\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.067287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.067186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-tmp-dir\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.067287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.067222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-model-cache\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.067287 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.067247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-dshm\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.067402 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.067290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-home\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.067794 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.067760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-tmp-dir\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.068066 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.068042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-model-cache\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.068171 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.068075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-home\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.070036 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.070007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-dshm\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.070297 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.070279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d43498-14de-43f8-aa74-745aeba5f2fe-tls-certs\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.076587 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.076564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8s4v\" (UniqueName: \"kubernetes.io/projected/04d43498-14de-43f8-aa74-745aeba5f2fe-kube-api-access-m8s4v\") pod \"auth-test-model-e412c4-kserve-5556bc9d99-nkd6s\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.121740 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.121654    2565 patch_prober.go:28] interesting pod/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:52:07.121740 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.121721    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 10 15:52:07.187875 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.187836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:07.474386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.474336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"]
Sep 10 15:52:07.476809 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:52:07.476779    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04d43498_14de_43f8_aa74_745aeba5f2fe.slice/crio-074baa325988880d3adbe3b9fc52a8fd77efa2151b940b85009db451ae933aa5 WatchSource:0}: Error finding container 074baa325988880d3adbe3b9fc52a8fd77efa2151b940b85009db451ae933aa5: Status 404 returned error can't find the container with id 074baa325988880d3adbe3b9fc52a8fd77efa2151b940b85009db451ae933aa5
Sep 10 15:52:07.656791 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.656744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:52:07.885173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.885082    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s" event={"ID":"04d43498-14de-43f8-aa74-745aeba5f2fe","Type":"ContainerStarted","Data":"dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e"}
Sep 10 15:52:07.885173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.885132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s" event={"ID":"04d43498-14de-43f8-aa74-745aeba5f2fe","Type":"ContainerStarted","Data":"074baa325988880d3adbe3b9fc52a8fd77efa2151b940b85009db451ae933aa5"}
Sep 10 15:52:07.913434 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:07.913375    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s" podStartSLOduration=1.913354223 podStartE2EDuration="1.913354223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:52:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:52:07.911544194 +0000 UTC m=+1204.726619949" watchObservedRunningTime="2026-09-10 15:52:07.913354223 +0000 UTC m=+1204.728429963"
Sep 10 15:52:08.122291 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:08.122252    2565 patch_prober.go:28] interesting pod/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:52:08.122467 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:08.122308    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 10 15:52:09.121685 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:09.121641    2565 patch_prober.go:28] interesting pod/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 10 15:52:09.122126 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:09.121703    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 10 15:52:09.651858 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:09.651803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:52:10.280449 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:10.280413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:52:10.280933 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:10.280847    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:52:10.283201 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:10.283176    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:52:14.350107 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:14.350069    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:52:17.188584 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:17.188547    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:17.189141 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:17.188604    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:17.200935 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:17.200904    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:17.949646 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:17.949616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:52:23.838709 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.838672    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"]
Sep 10 15:52:23.843677 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.843655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:23.847041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.846997    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c1384d3d\"/\"openshift-service-ca.crt\""
Sep 10 15:52:23.847041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.847008    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c1384d3d\"/\"e2e-lifecycle-model-c1384d3d-kserve-self-signed-certs\""
Sep 10 15:52:23.847233 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.847072    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c1384d3d\"/\"default-dockercfg-4g8gq\""
Sep 10 15:52:23.847233 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.847112    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c1384d3d\"/\"kube-root-ca.crt\""
Sep 10 15:52:23.853615 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.853587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"]
Sep 10 15:52:23.874789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.874761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:52:23.949873 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.949839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-model-cache\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:23.950067 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.949888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8vk\" (UniqueName: \"kubernetes.io/projected/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-kube-api-access-tm8vk\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:23.950067 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.949920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tmp-dir\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:23.950067 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.949941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-home\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:23.950067 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.950018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tls-certs\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:23.950212 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:23.950076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-dshm\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tmp-dir\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-home\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051355 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tls-certs\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051355 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-dshm\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051355 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-model-cache\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051355 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8vk\" (UniqueName: \"kubernetes.io/projected/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-kube-api-access-tm8vk\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051571 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tmp-dir\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051630 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-home\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.051682 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.051671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-model-cache\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.053612 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.053589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-dshm\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.053849 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.053832    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tls-certs\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.059168 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.059143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8vk\" (UniqueName: \"kubernetes.io/projected/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-kube-api-access-tm8vk\") pod \"e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") " pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.155225 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.155193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:24.437236 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.432639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"]
Sep 10 15:52:24.977939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.977905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf" event={"ID":"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe","Type":"ContainerStarted","Data":"0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7"}
Sep 10 15:52:24.977939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.977947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf" event={"ID":"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe","Type":"ContainerStarted","Data":"3fa13fc69905783f7a9e03b2212b310e0056f4f9ccd28a258e127f2fb474788f"}
Sep 10 15:52:24.996665 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:24.996604    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf" podStartSLOduration=1.996588466 podStartE2EDuration="1.996588466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:52:24.994385323 +0000 UTC m=+1221.809461085" watchObservedRunningTime="2026-09-10 15:52:24.996588466 +0000 UTC m=+1221.811664206"
Sep 10 15:52:27.642988 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:27.642937    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:52:34.156302 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:34.156269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:34.156756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:34.156317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:34.169104 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:34.169074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:35.045808 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:35.045774    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:52:45.341752 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:52:45.341715    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:53:03.241273 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:03.241195    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:53:04.727333 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:04.727299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:04.799794 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:04.799759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:04.859359 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:04.859329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:04.933889 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:04.933854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:04.988414 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:04.988333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:08.268911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:08.268876    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:13.247909 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:13.247872    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"]
Sep 10 15:53:13.291954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:13.291922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:19.346714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:19.346680    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:53:28.267953 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.267890    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf" podUID="fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" containerName="main" containerID="cri-o://0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7" gracePeriod=45
Sep 10 15:53:28.524241 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.524171    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:53:28.662265 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-model-cache\") pod \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") "
Sep 10 15:53:28.662481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tmp-dir\") pod \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") "
Sep 10 15:53:28.662481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662339    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tls-certs\") pod \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") "
Sep 10 15:53:28.662481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-dshm\") pod \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") "
Sep 10 15:53:28.662481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-home\") pod \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") "
Sep 10 15:53:28.662705 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662516    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm8vk\" (UniqueName: \"kubernetes.io/projected/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-kube-api-access-tm8vk\") pod \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\" (UID: \"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe\") "
Sep 10 15:53:28.662705 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-model-cache" (OuterVolumeSpecName: "model-cache") pod "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" (UID: "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:28.662705 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662642    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" (UID: "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:28.663036 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-home" (OuterVolumeSpecName: "home") pod "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" (UID: "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:28.663036 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662939    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:28.663036 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662956    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:28.663036 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.662989    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:28.665403 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.665367    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-dshm" (OuterVolumeSpecName: "dshm") pod "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" (UID: "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:28.665403 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.665373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" (UID: "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:53:28.665587 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.665505    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-kube-api-access-tm8vk" (OuterVolumeSpecName: "kube-api-access-tm8vk") pod "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" (UID: "fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe"). InnerVolumeSpecName "kube-api-access-tm8vk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:53:28.764386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.764334    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm8vk\" (UniqueName: \"kubernetes.io/projected/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-kube-api-access-tm8vk\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:28.764386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.764378    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:28.764386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:28.764391    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:29.328709 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.328670    2565 generic.go:356] "Generic (PLEG): container finished" podID="fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" containerID="0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7" exitCode=0
Sep 10 15:53:29.329179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.328716    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"
Sep 10 15:53:29.329179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.328738    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf" event={"ID":"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe","Type":"ContainerDied","Data":"0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7"}
Sep 10 15:53:29.329179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.328770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf" event={"ID":"fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe","Type":"ContainerDied","Data":"3fa13fc69905783f7a9e03b2212b310e0056f4f9ccd28a258e127f2fb474788f"}
Sep 10 15:53:29.329179 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.328787    2565 scope.go:117] "RemoveContainer" containerID="0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7"
Sep 10 15:53:29.338782 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.338759    2565 scope.go:117] "RemoveContainer" containerID="0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7"
Sep 10 15:53:29.339112 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:53:29.339094    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7\": container with ID starting with 0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7 not found: ID does not exist" containerID="0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7"
Sep 10 15:53:29.339185 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.339123    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7"} err="failed to get container status \"0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7\": rpc error: code = NotFound desc = could not find container \"0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7\": container with ID starting with 0618f1f344a66c219ba8141a237d23e22cdafd5fe4dd76278798713213e4fea7 not found: ID does not exist"
Sep 10 15:53:29.349540 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.349506    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"]
Sep 10 15:53:29.355290 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.355259    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c1384d3d/e2e-lifecycle-model-c1384d3d-kserve-76df4d8df9-g29hf"]
Sep 10 15:53:29.824762 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:29.824725    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" path="/var/lib/kubelet/pods/fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe/volumes"
Sep 10 15:53:35.458117 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:35.458079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:53:44.118107 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:44.118068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:45.467239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:45.467200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:48.745701 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:48.745665    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:53:50.486672 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:50.486641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:50.587444 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:50.587386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:50.739237 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:50.739143    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"]
Sep 10 15:53:50.739408 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:50.739361    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy" containerID="cri-o://b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89" gracePeriod=30
Sep 10 15:53:50.763205 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:50.763176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:52.095978 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:52.095925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:52.255109 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:52.255071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:52.367527 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:52.367443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:52.985725 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:52.985694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:53.081101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:53.081072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:53.176803 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:53.176769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:54.493421 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:54.493385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:53:55.283281 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:55.283242    2565 patch_prober.go:28] interesting pod/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:53:55.283482 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:55.283342    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:53:55.987250 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:55.987228    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:53:56.032507 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032431    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3af30544-447f-456c-ab39-0b5c50bed28a-istiod-ca-cert\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.032507 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-envoy\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.032507 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032507    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-socket\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.032718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-credential-socket\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.032718 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3af30544-447f-456c-ab39-0b5c50bed28a-istio-podinfo\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.032823 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032735    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-certs\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.032823 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032765    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-data\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.032823 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032760    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:56.032999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032855    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:56.032999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032862    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64bjc\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-kube-api-access-64bjc\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.032999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.032862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3af30544-447f-456c-ab39-0b5c50bed28a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:53:56.033162 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.033017    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-istio-token\") pod \"3af30544-447f-456c-ab39-0b5c50bed28a\" (UID: \"3af30544-447f-456c-ab39-0b5c50bed28a\") "
Sep 10 15:53:56.033448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.033386    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3af30544-447f-456c-ab39-0b5c50bed28a-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.033448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.033410    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.033448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.033425    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.033448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.033435    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:56.033708 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.033452    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:56.034737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.034713    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:53:56.035301 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.035282    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-kube-api-access-64bjc" (OuterVolumeSpecName: "kube-api-access-64bjc") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "kube-api-access-64bjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:53:56.035719 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.035690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3af30544-447f-456c-ab39-0b5c50bed28a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:53:56.035846 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.035723    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3af30544-447f-456c-ab39-0b5c50bed28a" (UID: "3af30544-447f-456c-ab39-0b5c50bed28a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:53:56.134618 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.134589    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.134618 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.134614    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3af30544-447f-456c-ab39-0b5c50bed28a-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.134775 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.134625    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.134775 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.134633    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3af30544-447f-456c-ab39-0b5c50bed28a-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.134775 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.134641    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64bjc\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-kube-api-access-64bjc\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.134775 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.134652    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3af30544-447f-456c-ab39-0b5c50bed28a-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:53:56.475847 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.475805    2565 generic.go:356] "Generic (PLEG): container finished" podID="3af30544-447f-456c-ab39-0b5c50bed28a" containerID="b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89" exitCode=0
Sep 10 15:53:56.476045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.475859    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"
Sep 10 15:53:56.476045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.475867    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" event={"ID":"3af30544-447f-456c-ab39-0b5c50bed28a","Type":"ContainerDied","Data":"b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89"}
Sep 10 15:53:56.476045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.475910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k" event={"ID":"3af30544-447f-456c-ab39-0b5c50bed28a","Type":"ContainerDied","Data":"3748c301afa70e7726989759a442db048f6dd167ab122ae0b8dd6d9a82271fbe"}
Sep 10 15:53:56.476045 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.475931    2565 scope.go:117] "RemoveContainer" containerID="b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89"
Sep 10 15:53:56.485838 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.485821    2565 scope.go:117] "RemoveContainer" containerID="8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc"
Sep 10 15:53:56.493768 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.493751    2565 scope.go:117] "RemoveContainer" containerID="b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89"
Sep 10 15:53:56.494043 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:53:56.494022    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89\": container with ID starting with b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89 not found: ID does not exist" containerID="b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89"
Sep 10 15:53:56.494094 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.494051    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89"} err="failed to get container status \"b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89\": rpc error: code = NotFound desc = could not find container \"b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89\": container with ID starting with b57c8811048088da07f1f273b8a4f93df1ae69e7af45246ff554edcfafa38b89 not found: ID does not exist"
Sep 10 15:53:56.494094 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.494067    2565 scope.go:117] "RemoveContainer" containerID="8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc"
Sep 10 15:53:56.494424 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:53:56.494398    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc\": container with ID starting with 8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc not found: ID does not exist" containerID="8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc"
Sep 10 15:53:56.494532 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.494431    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc"} err="failed to get container status \"8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc\": rpc error: code = NotFound desc = could not find container \"8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc\": container with ID starting with 8fca5b161a40de63a6facc421d229ac32a4ca8b0905f9d73c9e85d4e5271c1fc not found: ID does not exist"
Sep 10 15:53:56.497018 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.496997    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"]
Sep 10 15:53:56.502713 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:56.502689    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c1384d3d-openshift-default-664db7bdb8-xnt9k"]
Sep 10 15:53:57.824216 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:53:57.824179    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" path="/var/lib/kubelet/pods/3af30544-447f-456c-ab39-0b5c50bed28a/volumes"
Sep 10 15:54:00.424017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:00.423986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:00.483807 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:00.483774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:01.111293 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:01.111260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:05.846699 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:05.846663    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:54:06.805422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:06.805380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:06.912605 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:06.912570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:07.013730 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:07.013696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:08.925490 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925454    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-8177-70a773"]
Sep 10 15:54:08.925878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925851    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy"
Sep 10 15:54:08.925878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925864    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy"
Sep 10 15:54:08.925878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925878    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy"
Sep 10 15:54:08.926031 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925884    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy"
Sep 10 15:54:08.926031 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925895    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" containerName="main"
Sep 10 15:54:08.926031 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925900    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" containerName="main"
Sep 10 15:54:08.926031 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925983    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy"
Sep 10 15:54:08.926031 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.925999    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe1db1c-4f67-4c58-b0fa-25ed78fe6efe" containerName="main"
Sep 10 15:54:08.930365 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.930348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8177-70a773"
Sep 10 15:54:08.933053 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.933027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tpk2l\""
Sep 10 15:54:08.934731 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:08.934709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-8177-70a773"]
Sep 10 15:54:09.056255 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:09.056229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbvj\" (UniqueName: \"kubernetes.io/projected/a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a-kube-api-access-rpbvj\") pod \"mt-curl-8177-70a773\" (UID: \"a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a\") " pod="opendatahub/mt-curl-8177-70a773"
Sep 10 15:54:09.156713 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:09.156681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbvj\" (UniqueName: \"kubernetes.io/projected/a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a-kube-api-access-rpbvj\") pod \"mt-curl-8177-70a773\" (UID: \"a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a\") " pod="opendatahub/mt-curl-8177-70a773"
Sep 10 15:54:09.164900 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:09.164876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbvj\" (UniqueName: \"kubernetes.io/projected/a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a-kube-api-access-rpbvj\") pod \"mt-curl-8177-70a773\" (UID: \"a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a\") " pod="opendatahub/mt-curl-8177-70a773"
Sep 10 15:54:09.241545 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:09.241477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8177-70a773"
Sep 10 15:54:09.511514 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:09.511433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-8177-70a773"]
Sep 10 15:54:09.513991 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:54:09.513945    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5fdf9b2_e0fb_43e2_9c88_9db32e431b4a.slice/crio-3977157b987116778eeb24f2b1115f86b3d0764c85df9a8de41337ea82fafd52 WatchSource:0}: Error finding container 3977157b987116778eeb24f2b1115f86b3d0764c85df9a8de41337ea82fafd52: Status 404 returned error can't find the container with id 3977157b987116778eeb24f2b1115f86b3d0764c85df9a8de41337ea82fafd52
Sep 10 15:54:09.515450 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:09.515433    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 15:54:09.555813 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:09.555784    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-8177-70a773" event={"ID":"a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a","Type":"ContainerStarted","Data":"3977157b987116778eeb24f2b1115f86b3d0764c85df9a8de41337ea82fafd52"}
Sep 10 15:54:10.562525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:10.562442    2565 generic.go:356] "Generic (PLEG): container finished" podID="a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a" containerID="4999a5cb92785313d237a499cfed41fbc35281c057870eedef211fcdd982d44b" exitCode=0
Sep 10 15:54:10.562525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:10.562486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-8177-70a773" event={"ID":"a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a","Type":"ContainerDied","Data":"4999a5cb92785313d237a499cfed41fbc35281c057870eedef211fcdd982d44b"}
Sep 10 15:54:11.701409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:11.701387    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8177-70a773"
Sep 10 15:54:11.720025 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:11.719998    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-8177-70a773_a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a/mt-curl-8177-70a773/0.log"
Sep 10 15:54:11.744265 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:11.744238    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-8177-70a773"]
Sep 10 15:54:11.747022 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:11.747000    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-8177-70a773"]
Sep 10 15:54:11.777363 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:11.777339    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpbvj\" (UniqueName: \"kubernetes.io/projected/a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a-kube-api-access-rpbvj\") pod \"a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a\" (UID: \"a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a\") "
Sep 10 15:54:11.779312 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:11.779295    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a-kube-api-access-rpbvj" (OuterVolumeSpecName: "kube-api-access-rpbvj") pod "a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a" (UID: "a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a"). InnerVolumeSpecName "kube-api-access-rpbvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:54:11.824141 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:11.824082    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a" path="/var/lib/kubelet/pods/a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a/volumes"
Sep 10 15:54:11.878062 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:11.878037    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpbvj\" (UniqueName: \"kubernetes.io/projected/a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a-kube-api-access-rpbvj\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:54:12.573576 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:12.573546    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-8177-70a773"
Sep 10 15:54:12.573576 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:12.573576    2565 scope.go:117] "RemoveContainer" containerID="4999a5cb92785313d237a499cfed41fbc35281c057870eedef211fcdd982d44b"
Sep 10 15:54:13.176773 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:13.176739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:13.734450 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:13.734413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:14.058425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:14.058340    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"]
Sep 10 15:54:14.146925 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:14.146894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:17.244986 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:17.244940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:54:17.571091 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:17.571002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:17.801893 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:17.801857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:23.842231 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.842196    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"]
Sep 10 15:54:23.842683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.842611    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a" containerName="mt-curl-8177-70a773"
Sep 10 15:54:23.842683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.842626    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a" containerName="mt-curl-8177-70a773"
Sep 10 15:54:23.842785 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.842686    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5fdf9b2-e0fb-43e2-9c88-9db32e431b4a" containerName="mt-curl-8177-70a773"
Sep 10 15:54:23.842785 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.842699    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af30544-447f-456c-ab39-0b5c50bed28a" containerName="istio-proxy"
Sep 10 15:54:23.847300 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.847284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:23.849999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.849975    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-6f8c71\"/\"openshift-service-ca.crt\""
Sep 10 15:54:23.851255 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.851231    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-6f8c71\"/\"sub-test-model-6f8c71-kserve-self-signed-certs\""
Sep 10 15:54:23.851375 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.851254    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-6f8c71\"/\"kube-root-ca.crt\""
Sep 10 15:54:23.851375 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.851257    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-6f8c71\"/\"default-dockercfg-g7czv\""
Sep 10 15:54:23.856606 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.856585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"]
Sep 10 15:54:23.867283 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.867262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:23.996822 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.996789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/873298b3-8e19-493c-82e1-a3f3e853cd7f-tls-certs\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:23.997019 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.996859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-tmp-dir\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:23.997019 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.996949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-dshm\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:23.997111 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.997018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-model-cache\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:23.997111 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.997070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-home\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:23.997299 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:23.997273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnrfz\" (UniqueName: \"kubernetes.io/projected/873298b3-8e19-493c-82e1-a3f3e853cd7f-kube-api-access-bnrfz\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098248 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnrfz\" (UniqueName: \"kubernetes.io/projected/873298b3-8e19-493c-82e1-a3f3e853cd7f-kube-api-access-bnrfz\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098248 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/873298b3-8e19-493c-82e1-a3f3e853cd7f-tls-certs\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098469 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-tmp-dir\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098469 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-dshm\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098469 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-model-cache\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098469 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-home\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098737 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-model-cache\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098790 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-tmp-dir\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.098828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.098786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-home\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.100601 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.100578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-dshm\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.100865 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.100848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/873298b3-8e19-493c-82e1-a3f3e853cd7f-tls-certs\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.107894 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.107872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnrfz\" (UniqueName: \"kubernetes.io/projected/873298b3-8e19-493c-82e1-a3f3e853cd7f-kube-api-access-bnrfz\") pod \"sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") " pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.158375 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.158344    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:24.432496 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.432473    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"]
Sep 10 15:54:24.434608 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:54:24.434582    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod873298b3_8e19_493c_82e1_a3f3e853cd7f.slice/crio-a68e7ce78af31c9de34bf7fb78a8c526861e795109723a76bcb4022605180a2e WatchSource:0}: Error finding container a68e7ce78af31c9de34bf7fb78a8c526861e795109723a76bcb4022605180a2e: Status 404 returned error can't find the container with id a68e7ce78af31c9de34bf7fb78a8c526861e795109723a76bcb4022605180a2e
Sep 10 15:54:24.640432 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.640385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6" event={"ID":"873298b3-8e19-493c-82e1-a3f3e853cd7f","Type":"ContainerStarted","Data":"a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c"}
Sep 10 15:54:24.640650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.640443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6" event={"ID":"873298b3-8e19-493c-82e1-a3f3e853cd7f","Type":"ContainerStarted","Data":"a68e7ce78af31c9de34bf7fb78a8c526861e795109723a76bcb4022605180a2e"}
Sep 10 15:54:24.660081 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:24.660034    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6" podStartSLOduration=1.660020062 podStartE2EDuration="1.660020062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:54:24.658321161 +0000 UTC m=+1341.473396902" watchObservedRunningTime="2026-09-10 15:54:24.660020062 +0000 UTC m=+1341.475095802"
Sep 10 15:54:28.749696 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:28.749605    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:54:29.078289 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.078206    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s" podUID="04d43498-14de-43f8-aa74-745aeba5f2fe" containerName="main" containerID="cri-o://dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e" gracePeriod=45
Sep 10 15:54:29.336555 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.336486    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:54:29.358730 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.358701    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-home\") pod \"04d43498-14de-43f8-aa74-745aeba5f2fe\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") "
Sep 10 15:54:29.358876 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.358784    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-model-cache\") pod \"04d43498-14de-43f8-aa74-745aeba5f2fe\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") "
Sep 10 15:54:29.358876 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.358843    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-tmp-dir\") pod \"04d43498-14de-43f8-aa74-745aeba5f2fe\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") "
Sep 10 15:54:29.359526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.358899    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d43498-14de-43f8-aa74-745aeba5f2fe-tls-certs\") pod \"04d43498-14de-43f8-aa74-745aeba5f2fe\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") "
Sep 10 15:54:29.359526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.358935    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8s4v\" (UniqueName: \"kubernetes.io/projected/04d43498-14de-43f8-aa74-745aeba5f2fe-kube-api-access-m8s4v\") pod \"04d43498-14de-43f8-aa74-745aeba5f2fe\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") "
Sep 10 15:54:29.359526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.358992    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-dshm\") pod \"04d43498-14de-43f8-aa74-745aeba5f2fe\" (UID: \"04d43498-14de-43f8-aa74-745aeba5f2fe\") "
Sep 10 15:54:29.359526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.358996    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-home" (OuterVolumeSpecName: "home") pod "04d43498-14de-43f8-aa74-745aeba5f2fe" (UID: "04d43498-14de-43f8-aa74-745aeba5f2fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:54:29.359526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.359087    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "04d43498-14de-43f8-aa74-745aeba5f2fe" (UID: "04d43498-14de-43f8-aa74-745aeba5f2fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:54:29.359526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.359364    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:54:29.359526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.359383    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:54:29.359526 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.359415    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "04d43498-14de-43f8-aa74-745aeba5f2fe" (UID: "04d43498-14de-43f8-aa74-745aeba5f2fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:54:29.361859 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.361829    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d43498-14de-43f8-aa74-745aeba5f2fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "04d43498-14de-43f8-aa74-745aeba5f2fe" (UID: "04d43498-14de-43f8-aa74-745aeba5f2fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:54:29.362318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.362287    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d43498-14de-43f8-aa74-745aeba5f2fe-kube-api-access-m8s4v" (OuterVolumeSpecName: "kube-api-access-m8s4v") pod "04d43498-14de-43f8-aa74-745aeba5f2fe" (UID: "04d43498-14de-43f8-aa74-745aeba5f2fe"). InnerVolumeSpecName "kube-api-access-m8s4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:54:29.362409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.362364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-dshm" (OuterVolumeSpecName: "dshm") pod "04d43498-14de-43f8-aa74-745aeba5f2fe" (UID: "04d43498-14de-43f8-aa74-745aeba5f2fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:54:29.460277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.460240    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:54:29.460277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.460272    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04d43498-14de-43f8-aa74-745aeba5f2fe-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:54:29.460277 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.460285    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8s4v\" (UniqueName: \"kubernetes.io/projected/04d43498-14de-43f8-aa74-745aeba5f2fe-kube-api-access-m8s4v\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:54:29.460584 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.460294    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04d43498-14de-43f8-aa74-745aeba5f2fe-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:54:29.668487 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.668454    2565 generic.go:356] "Generic (PLEG): container finished" podID="04d43498-14de-43f8-aa74-745aeba5f2fe" containerID="dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e" exitCode=0
Sep 10 15:54:29.668703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.668510    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"
Sep 10 15:54:29.668703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.668572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s" event={"ID":"04d43498-14de-43f8-aa74-745aeba5f2fe","Type":"ContainerDied","Data":"dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e"}
Sep 10 15:54:29.668703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.668614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s" event={"ID":"04d43498-14de-43f8-aa74-745aeba5f2fe","Type":"ContainerDied","Data":"074baa325988880d3adbe3b9fc52a8fd77efa2151b940b85009db451ae933aa5"}
Sep 10 15:54:29.668703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.668632    2565 scope.go:117] "RemoveContainer" containerID="dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e"
Sep 10 15:54:29.678692 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.678674    2565 scope.go:117] "RemoveContainer" containerID="dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e"
Sep 10 15:54:29.678995 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:54:29.678976    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e\": container with ID starting with dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e not found: ID does not exist" containerID="dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e"
Sep 10 15:54:29.679050 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.679004    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e"} err="failed to get container status \"dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e\": rpc error: code = NotFound desc = could not find container \"dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e\": container with ID starting with dc70e59e102e91cfe47a0a09a0f591ce042e27166a440ac10326649b2f77057e not found: ID does not exist"
Sep 10 15:54:29.698457 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.698428    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"]
Sep 10 15:54:29.699212 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.699184    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/auth-test-model-e412c4-kserve-5556bc9d99-nkd6s"]
Sep 10 15:54:29.824440 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:29.824395    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d43498-14de-43f8-aa74-745aeba5f2fe" path="/var/lib/kubelet/pods/04d43498-14de-43f8-aa74-745aeba5f2fe/volumes"
Sep 10 15:54:34.159343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:34.159306    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:34.159743 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:34.159356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:34.171863 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:34.171828    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:34.706185 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:34.706149    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:54:38.798714 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:38.798682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:39.849258 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.849221    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"]
Sep 10 15:54:39.849847 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.849825    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d43498-14de-43f8-aa74-745aeba5f2fe" containerName="main"
Sep 10 15:54:39.849913 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.849851    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d43498-14de-43f8-aa74-745aeba5f2fe" containerName="main"
Sep 10 15:54:39.850027 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.850012    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d43498-14de-43f8-aa74-745aeba5f2fe" containerName="main"
Sep 10 15:54:39.853448 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.853427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:39.857340 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.857312    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"openshift-service-ca.crt\""
Sep 10 15:54:39.857497 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.857310    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"kube-root-ca.crt\""
Sep 10 15:54:39.857497 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.857314    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"default-dockercfg-67h76\""
Sep 10 15:54:39.857497 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.857471    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"sub-test-model-e412c4-kserve-self-signed-certs\""
Sep 10 15:54:39.861172 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.861146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"]
Sep 10 15:54:39.883720 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.883687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:39.966351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.966303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-dshm\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:39.966540 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.966425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxqt\" (UniqueName: \"kubernetes.io/projected/b2896dd6-4617-44ed-a459-4700249fc627-kube-api-access-gpxqt\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:39.966540 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.966473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2896dd6-4617-44ed-a459-4700249fc627-tls-certs\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:39.966631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.966539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-home\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:39.966631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.966629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-model-cache\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:39.966725 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:39.966713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-tmp-dir\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.067643 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.067599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-tmp-dir\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.067829 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.067738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-dshm\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.067829 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.067769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxqt\" (UniqueName: \"kubernetes.io/projected/b2896dd6-4617-44ed-a459-4700249fc627-kube-api-access-gpxqt\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.067829 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.067790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2896dd6-4617-44ed-a459-4700249fc627-tls-certs\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.067829 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.067814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-home\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.068043 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.067928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-model-cache\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.068115 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.068089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-tmp-dir\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.068231 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.068214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-home\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.068339 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.068323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-model-cache\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.070197 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.070169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-dshm\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.070371 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.070351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2896dd6-4617-44ed-a459-4700249fc627-tls-certs\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.076025 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.075996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxqt\" (UniqueName: \"kubernetes.io/projected/b2896dd6-4617-44ed-a459-4700249fc627-kube-api-access-gpxqt\") pod \"sub-test-model-e412c4-kserve-5688d56545-fdkmx\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.166274 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.166238    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:40.442619 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.442589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"]
Sep 10 15:54:40.444872 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:54:40.444838    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2896dd6_4617_44ed_a459_4700249fc627.slice/crio-612646b642aa8d1a048222290e7a5820a95cfd8e036fe5fa02613ec2110f1cd5 WatchSource:0}: Error finding container 612646b642aa8d1a048222290e7a5820a95cfd8e036fe5fa02613ec2110f1cd5: Status 404 returned error can't find the container with id 612646b642aa8d1a048222290e7a5820a95cfd8e036fe5fa02613ec2110f1cd5
Sep 10 15:54:40.734189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.734089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx" event={"ID":"b2896dd6-4617-44ed-a459-4700249fc627","Type":"ContainerStarted","Data":"c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b"}
Sep 10 15:54:40.734189 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.734135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx" event={"ID":"b2896dd6-4617-44ed-a459-4700249fc627","Type":"ContainerStarted","Data":"612646b642aa8d1a048222290e7a5820a95cfd8e036fe5fa02613ec2110f1cd5"}
Sep 10 15:54:40.751515 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:40.751459    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx" podStartSLOduration=1.751444234 podStartE2EDuration="1.751444234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:54:40.750269418 +0000 UTC m=+1357.565345160" watchObservedRunningTime="2026-09-10 15:54:40.751444234 +0000 UTC m=+1357.566519977"
Sep 10 15:54:41.468212 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:41.468171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:41.569318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:41.569286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:44.258716 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:44.258674    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:54:44.580247 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:44.580151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:44.638674 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:44.638643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:44.900125 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:44.900094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:45.246652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:45.246565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:45.347689 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:45.347655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:48.082300 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:48.082262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:48.184174 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:48.184144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:49.235235 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:49.235208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:49.298665 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:49.298625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:49.620235 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:49.620151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:49.726008 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:49.725976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:49.803334 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:49.803290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:54:50.167030 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:50.166988    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:50.167285 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:50.167264    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:50.179688 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:50.179660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:54:50.804309 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:54:50.804269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:55:02.055917 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:02.055880    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:55:13.137417 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:13.137378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:13.644900 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:13.644867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:13.931295 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:13.931260    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"]
Sep 10 15:55:13.936747 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:13.936718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:13.939164 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:13.939139    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-86fc05-openshift-default-dockercfg-954mp\""
Sep 10 15:55:13.946985 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:13.946931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"]
Sep 10 15:55:13.955612 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:13.955583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:14.009355 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-token\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.009355 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-data\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.009574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istiod-ca-cert\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.009574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9tt2\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-kube-api-access-s9tt2\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.009574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-credential-socket\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.009574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-certs\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.009574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-podinfo\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.009739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009582    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-socket\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.009739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.009598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-envoy\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.087268 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.087236    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:14.111127 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-credential-socket\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111127 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-certs\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111368 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-podinfo\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111368 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-socket\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111368 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-envoy\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111368 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-token\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111571 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-data\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111571 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istiod-ca-cert\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111571 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9tt2\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-kube-api-access-s9tt2\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111571 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-credential-socket\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111832 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-socket\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.111985 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.111949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-certs\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.112056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.112008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-data\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.112199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.112180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istiod-ca-cert\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.113633 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.113609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-envoy\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.113845 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.113830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-podinfo\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.119298 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.119278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9tt2\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-kube-api-access-s9tt2\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.119391 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.119310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-token\") pod \"e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") " pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.254578 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.254473    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:14.535006 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.534979    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"]
Sep 10 15:55:14.537603 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:55:14.537571    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0cb6c0_a11b_41c5_a032_9f1224697a27.slice/crio-032231bb38d76b32ee2885354961a2cefb06bc98b833c77336e47b5da284129a WatchSource:0}: Error finding container 032231bb38d76b32ee2885354961a2cefb06bc98b833c77336e47b5da284129a: Status 404 returned error can't find the container with id 032231bb38d76b32ee2885354961a2cefb06bc98b833c77336e47b5da284129a
Sep 10 15:55:14.540088 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.540042    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:55:14.540163 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.540137    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:55:14.540212 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.540183    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:55:14.923081 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.923044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" event={"ID":"ab0cb6c0-a11b-41c5-a032-9f1224697a27","Type":"ContainerStarted","Data":"0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e"}
Sep 10 15:55:14.923257 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.923107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" event={"ID":"ab0cb6c0-a11b-41c5-a032-9f1224697a27","Type":"ContainerStarted","Data":"032231bb38d76b32ee2885354961a2cefb06bc98b833c77336e47b5da284129a"}
Sep 10 15:55:14.944783 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:14.944737    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" podStartSLOduration=1.944723269 podStartE2EDuration="1.944723269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:55:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:55:14.94218181 +0000 UTC m=+1391.757257568" watchObservedRunningTime="2026-09-10 15:55:14.944723269 +0000 UTC m=+1391.759799008"
Sep 10 15:55:15.255691 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:15.255607    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:15.261034 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:15.261004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:15.928979 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:15.928926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:15.929785 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:15.929761    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:16.940646 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:16.940617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:17.041401 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:17.041370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:18.078473 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.078438    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"]
Sep 10 15:55:18.083005 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.082981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.086500 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.086466    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:55:18.086500 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.086481    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ql4pw\""
Sep 10 15:55:18.086678 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.086520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 15:55:18.086678 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.086540    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 15:55:18.086678 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.086468    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-86fc05-serving-cert\""
Sep 10 15:55:18.092064 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.091992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"]
Sep 10 15:55:18.114911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.114885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:18.152220 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.152194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw5gz\" (UniqueName: \"kubernetes.io/projected/0bda0318-c147-4117-a6ed-077d4e0ae6d6-kube-api-access-kw5gz\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.152344 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.152251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bda0318-c147-4117-a6ed-077d4e0ae6d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.152344 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.152295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-metrics-certs\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.152344 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.152339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-maas-api-tls\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.169654 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.169630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:18.253383 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.253351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bda0318-c147-4117-a6ed-077d4e0ae6d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.253567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.253393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-metrics-certs\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.253567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.253434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-maas-api-tls\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.253567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.253502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw5gz\" (UniqueName: \"kubernetes.io/projected/0bda0318-c147-4117-a6ed-077d4e0ae6d6-kube-api-access-kw5gz\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.254062 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.254040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bda0318-c147-4117-a6ed-077d4e0ae6d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.255868 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.255847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-maas-api-tls\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.255955 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.255892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-metrics-certs\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.261603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.261578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw5gz\" (UniqueName: \"kubernetes.io/projected/0bda0318-c147-4117-a6ed-077d4e0ae6d6-kube-api-access-kw5gz\") pod \"maas-api-e2e-api-b-86fc05-966d7d68d-87b9v\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.277519 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.277493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:18.396948 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.396873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:18.672548 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.672516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"]
Sep 10 15:55:18.674354 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:55:18.674324    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bda0318_c147_4117_a6ed_077d4e0ae6d6.slice/crio-8533173d474a27fd33eac8b6d0a601f48471fb1079a6bae56bf30972b6a32e38 WatchSource:0}: Error finding container 8533173d474a27fd33eac8b6d0a601f48471fb1079a6bae56bf30972b6a32e38: Status 404 returned error can't find the container with id 8533173d474a27fd33eac8b6d0a601f48471fb1079a6bae56bf30972b6a32e38
Sep 10 15:55:18.695434 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.695407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:18.793183 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.793155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:18.947297 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:18.947216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v" event={"ID":"0bda0318-c147-4117-a6ed-077d4e0ae6d6","Type":"ContainerStarted","Data":"8533173d474a27fd33eac8b6d0a601f48471fb1079a6bae56bf30972b6a32e38"}
Sep 10 15:55:19.955087 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:19.955053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v" event={"ID":"0bda0318-c147-4117-a6ed-077d4e0ae6d6","Type":"ContainerStarted","Data":"99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc"}
Sep 10 15:55:19.955559 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:19.955162    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:19.972126 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:19.972080    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v" podStartSLOduration=1.523312896 podStartE2EDuration="1.972065469s" totalImagesPullingTime="448.752573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:55:19.971785997 +0000 UTC m=+1396.786861736" watchObservedRunningTime="2026-09-10 15:55:19.972065469 +0000 UTC m=+1396.787141209"
Sep 10 15:55:22.953872 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:22.953834    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:55:25.524720 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:25.524678    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"]
Sep 10 15:55:25.555985 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:25.542161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:25.968552 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:25.968521    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:55:26.739613 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:26.739573    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"]
Sep 10 15:55:26.819100 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:26.819062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:31.971100 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:31.971064    2565 patch_prober.go:28] interesting pod/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 15:55:31.971610 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:31.971152    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 15:55:32.900769 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:32.900725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:34.040738 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:34.040707    2565 generic.go:356] "Generic (PLEG): container finished" podID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerID="0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e" exitCode=0
Sep 10 15:55:34.041187 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:34.040761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" event={"ID":"ab0cb6c0-a11b-41c5-a032-9f1224697a27","Type":"ContainerDied","Data":"0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e"}
Sep 10 15:55:34.041187 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:34.041121    2565 scope.go:117] "RemoveContainer" containerID="0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e"
Sep 10 15:55:34.042334 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:34.042302    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:55:34.042415 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:34.042382    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:55:34.042455 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:34.042416    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:55:35.052670 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:35.052634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" event={"ID":"ab0cb6c0-a11b-41c5-a032-9f1224697a27","Type":"ContainerStarted","Data":"cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05"}
Sep 10 15:55:35.255059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:35.255010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:35.255318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:35.255292    2565 patch_prober.go:28] interesting pod/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 15:55:35.255372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:35.255348    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 15:55:36.255431 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:36.255391    2565 patch_prober.go:28] interesting pod/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 15:55:36.255919 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:36.255456    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 15:55:37.255351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:37.255301    2565 patch_prober.go:28] interesting pod/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 15:55:37.255569 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:37.255387    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 15:55:38.255462 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:38.255420    2565 patch_prober.go:28] interesting pod/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 15:55:38.255792 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:38.255758    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 15:55:39.255386 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:39.255343    2565 patch_prober.go:28] interesting pod/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 15:55:39.255695 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:39.255657    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 15:55:40.151908 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.151864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:55:40.441492 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.441406    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:40.441723 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.441700    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:40.442569 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.442545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:55:40.569986 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.569925    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6" podUID="873298b3-8e19-493c-82e1-a3f3e853cd7f" containerName="main" containerID="cri-o://a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c" gracePeriod=45
Sep 10 15:55:40.824296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.824272    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:55:40.891240 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891201    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-model-cache\") pod \"873298b3-8e19-493c-82e1-a3f3e853cd7f\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") "
Sep 10 15:55:40.891445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891260    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnrfz\" (UniqueName: \"kubernetes.io/projected/873298b3-8e19-493c-82e1-a3f3e853cd7f-kube-api-access-bnrfz\") pod \"873298b3-8e19-493c-82e1-a3f3e853cd7f\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") "
Sep 10 15:55:40.891445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891285    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/873298b3-8e19-493c-82e1-a3f3e853cd7f-tls-certs\") pod \"873298b3-8e19-493c-82e1-a3f3e853cd7f\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") "
Sep 10 15:55:40.891445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891312    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-home\") pod \"873298b3-8e19-493c-82e1-a3f3e853cd7f\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") "
Sep 10 15:55:40.891445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-dshm\") pod \"873298b3-8e19-493c-82e1-a3f3e853cd7f\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") "
Sep 10 15:55:40.891445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891362    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-tmp-dir\") pod \"873298b3-8e19-493c-82e1-a3f3e853cd7f\" (UID: \"873298b3-8e19-493c-82e1-a3f3e853cd7f\") "
Sep 10 15:55:40.891747 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-model-cache" (OuterVolumeSpecName: "model-cache") pod "873298b3-8e19-493c-82e1-a3f3e853cd7f" (UID: "873298b3-8e19-493c-82e1-a3f3e853cd7f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:55:40.891747 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "873298b3-8e19-493c-82e1-a3f3e853cd7f" (UID: "873298b3-8e19-493c-82e1-a3f3e853cd7f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:55:40.891872 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891756    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:40.891872 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.891850    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-home" (OuterVolumeSpecName: "home") pod "873298b3-8e19-493c-82e1-a3f3e853cd7f" (UID: "873298b3-8e19-493c-82e1-a3f3e853cd7f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:55:40.894270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.894220    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-dshm" (OuterVolumeSpecName: "dshm") pod "873298b3-8e19-493c-82e1-a3f3e853cd7f" (UID: "873298b3-8e19-493c-82e1-a3f3e853cd7f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:55:40.894270 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.894223    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/873298b3-8e19-493c-82e1-a3f3e853cd7f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "873298b3-8e19-493c-82e1-a3f3e853cd7f" (UID: "873298b3-8e19-493c-82e1-a3f3e853cd7f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:55:40.894606 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.894567    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/873298b3-8e19-493c-82e1-a3f3e853cd7f-kube-api-access-bnrfz" (OuterVolumeSpecName: "kube-api-access-bnrfz") pod "873298b3-8e19-493c-82e1-a3f3e853cd7f" (UID: "873298b3-8e19-493c-82e1-a3f3e853cd7f"). InnerVolumeSpecName "kube-api-access-bnrfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:55:40.993101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.993013    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnrfz\" (UniqueName: \"kubernetes.io/projected/873298b3-8e19-493c-82e1-a3f3e853cd7f-kube-api-access-bnrfz\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:40.993101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.993049    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/873298b3-8e19-493c-82e1-a3f3e853cd7f-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:40.993101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.993065    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:40.993101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.993077    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:40.993101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:40.993089    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/873298b3-8e19-493c-82e1-a3f3e853cd7f-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:41.093572 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.093532    2565 generic.go:356] "Generic (PLEG): container finished" podID="873298b3-8e19-493c-82e1-a3f3e853cd7f" containerID="a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c" exitCode=0
Sep 10 15:55:41.093763 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.093589    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"
Sep 10 15:55:41.093763 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.093621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6" event={"ID":"873298b3-8e19-493c-82e1-a3f3e853cd7f","Type":"ContainerDied","Data":"a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c"}
Sep 10 15:55:41.093763 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.093668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6" event={"ID":"873298b3-8e19-493c-82e1-a3f3e853cd7f","Type":"ContainerDied","Data":"a68e7ce78af31c9de34bf7fb78a8c526861e795109723a76bcb4022605180a2e"}
Sep 10 15:55:41.093763 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.093685    2565 scope.go:117] "RemoveContainer" containerID="a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c"
Sep 10 15:55:41.103804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.103786    2565 scope.go:117] "RemoveContainer" containerID="a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c"
Sep 10 15:55:41.104101 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:55:41.104083    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c\": container with ID starting with a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c not found: ID does not exist" containerID="a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c"
Sep 10 15:55:41.104176 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.104111    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c"} err="failed to get container status \"a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c\": rpc error: code = NotFound desc = could not find container \"a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c\": container with ID starting with a6ab569ef30ec8069beb3871d1a22d8a9b0f0953cd6264f1741233def2964e3c not found: ID does not exist"
Sep 10 15:55:41.115550 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.115531    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"]
Sep 10 15:55:41.119084 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.119055    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6f8c71/sub-test-model-6f8c71-kserve-c9b56f9d9-5xjt6"]
Sep 10 15:55:41.788872 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.788835    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx" podUID="b2896dd6-4617-44ed-a459-4700249fc627" containerName="main" containerID="cri-o://c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b" gracePeriod=45
Sep 10 15:55:41.825422 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.825396    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="873298b3-8e19-493c-82e1-a3f3e853cd7f" path="/var/lib/kubelet/pods/873298b3-8e19-493c-82e1-a3f3e853cd7f/volumes"
Sep 10 15:55:41.980303 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:41.980227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:42.043350 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.042816    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:55:42.101777 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.101745    2565 generic.go:356] "Generic (PLEG): container finished" podID="b2896dd6-4617-44ed-a459-4700249fc627" containerID="c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b" exitCode=0
Sep 10 15:55:42.101954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.101789    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"
Sep 10 15:55:42.101954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.101830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx" event={"ID":"b2896dd6-4617-44ed-a459-4700249fc627","Type":"ContainerDied","Data":"c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b"}
Sep 10 15:55:42.101954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.101863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx" event={"ID":"b2896dd6-4617-44ed-a459-4700249fc627","Type":"ContainerDied","Data":"612646b642aa8d1a048222290e7a5820a95cfd8e036fe5fa02613ec2110f1cd5"}
Sep 10 15:55:42.101954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.101881    2565 scope.go:117] "RemoveContainer" containerID="c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b"
Sep 10 15:55:42.102818 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.102799    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpxqt\" (UniqueName: \"kubernetes.io/projected/b2896dd6-4617-44ed-a459-4700249fc627-kube-api-access-gpxqt\") pod \"b2896dd6-4617-44ed-a459-4700249fc627\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") "
Sep 10 15:55:42.103049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.102884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-dshm\") pod \"b2896dd6-4617-44ed-a459-4700249fc627\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") "
Sep 10 15:55:42.103049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.102910    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2896dd6-4617-44ed-a459-4700249fc627-tls-certs\") pod \"b2896dd6-4617-44ed-a459-4700249fc627\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") "
Sep 10 15:55:42.103049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.102929    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-model-cache\") pod \"b2896dd6-4617-44ed-a459-4700249fc627\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") "
Sep 10 15:55:42.103049 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.103012    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-home\") pod \"b2896dd6-4617-44ed-a459-4700249fc627\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") "
Sep 10 15:55:42.103253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.103054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-tmp-dir\") pod \"b2896dd6-4617-44ed-a459-4700249fc627\" (UID: \"b2896dd6-4617-44ed-a459-4700249fc627\") "
Sep 10 15:55:42.103339 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.103317    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-home" (OuterVolumeSpecName: "home") pod "b2896dd6-4617-44ed-a459-4700249fc627" (UID: "b2896dd6-4617-44ed-a459-4700249fc627"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:55:42.103399 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.103334    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2896dd6-4617-44ed-a459-4700249fc627" (UID: "b2896dd6-4617-44ed-a459-4700249fc627"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:55:42.103476 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.103451    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2896dd6-4617-44ed-a459-4700249fc627" (UID: "b2896dd6-4617-44ed-a459-4700249fc627"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:55:42.103533 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.103513    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:42.103533 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.103528    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:42.105139 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.105119    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2896dd6-4617-44ed-a459-4700249fc627-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2896dd6-4617-44ed-a459-4700249fc627" (UID: "b2896dd6-4617-44ed-a459-4700249fc627"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:55:42.105421 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.105396    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-dshm" (OuterVolumeSpecName: "dshm") pod "b2896dd6-4617-44ed-a459-4700249fc627" (UID: "b2896dd6-4617-44ed-a459-4700249fc627"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:55:42.105525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.105491    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2896dd6-4617-44ed-a459-4700249fc627-kube-api-access-gpxqt" (OuterVolumeSpecName: "kube-api-access-gpxqt") pod "b2896dd6-4617-44ed-a459-4700249fc627" (UID: "b2896dd6-4617-44ed-a459-4700249fc627"). InnerVolumeSpecName "kube-api-access-gpxqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:55:42.126195 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.125180    2565 scope.go:117] "RemoveContainer" containerID="c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b"
Sep 10 15:55:42.126195 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:55:42.125516    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b\": container with ID starting with c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b not found: ID does not exist" containerID="c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b"
Sep 10 15:55:42.126195 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.125547    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b"} err="failed to get container status \"c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b\": rpc error: code = NotFound desc = could not find container \"c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b\": container with ID starting with c3e5a8fa161e81caad1bd1bd0c4f0135dbb58b6a15c1c3ef03a1bc36d45af66b not found: ID does not exist"
Sep 10 15:55:42.205124 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.205081    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:42.205124 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.205116    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpxqt\" (UniqueName: \"kubernetes.io/projected/b2896dd6-4617-44ed-a459-4700249fc627-kube-api-access-gpxqt\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:42.205124 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.205132    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2896dd6-4617-44ed-a459-4700249fc627-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:42.205351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.205141    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2896dd6-4617-44ed-a459-4700249fc627-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:55:42.432767 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.432735    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"]
Sep 10 15:55:42.436658 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:42.436636    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/sub-test-model-e412c4-kserve-5688d56545-fdkmx"]
Sep 10 15:55:43.824697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:43.824663    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2896dd6-4617-44ed-a459-4700249fc627" path="/var/lib/kubelet/pods/b2896dd6-4617-44ed-a459-4700249fc627/volumes"
Sep 10 15:55:45.276059 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:45.276024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:48.935905 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:48.935869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:50.835939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:50.835894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:55.271516 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:55.271465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:57.950378 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.950279    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"]
Sep 10 15:55:57.950861 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.950757    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="873298b3-8e19-493c-82e1-a3f3e853cd7f" containerName="main"
Sep 10 15:55:57.950861 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.950773    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="873298b3-8e19-493c-82e1-a3f3e853cd7f" containerName="main"
Sep 10 15:55:57.950861 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.950789    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2896dd6-4617-44ed-a459-4700249fc627" containerName="main"
Sep 10 15:55:57.950861 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.950794    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2896dd6-4617-44ed-a459-4700249fc627" containerName="main"
Sep 10 15:55:57.951645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.950867    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2896dd6-4617-44ed-a459-4700249fc627" containerName="main"
Sep 10 15:55:57.951645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.950877    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="873298b3-8e19-493c-82e1-a3f3e853cd7f" containerName="main"
Sep 10 15:55:57.956066 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.956041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:57.958383 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.958361    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"openshift-service-ca.crt\""
Sep 10 15:55:57.959234 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.959209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"default-dockercfg-67h76\""
Sep 10 15:55:57.959416 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.959393    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"kube-root-ca.crt\""
Sep 10 15:55:57.959662 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.959641    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e412c4\"/\"rate-test-model-e412c4-kserve-self-signed-certs\""
Sep 10 15:55:57.965043 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.964384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"]
Sep 10 15:55:57.983666 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:57.983617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:58.060484 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.060448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tmp-dir\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.060656 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.060493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmqfm\" (UniqueName: \"kubernetes.io/projected/75e3c7d2-68ce-4691-bc46-123bbb333e3a-kube-api-access-dmqfm\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.060656 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.060516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-home\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.060656 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.060560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-model-cache\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.060656 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.060585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tls-certs\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.060656 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.060618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-dshm\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.066920 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.066886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:55:58.161437 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-model-cache\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.161437 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tls-certs\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.161675 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-dshm\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.161675 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tmp-dir\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.161675 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmqfm\" (UniqueName: \"kubernetes.io/projected/75e3c7d2-68ce-4691-bc46-123bbb333e3a-kube-api-access-dmqfm\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.161675 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-home\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.161906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-model-cache\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.162060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tmp-dir\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.162060 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.161991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-home\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.163721 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.163692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-dshm\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.164161 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.164137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tls-certs\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.169453 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.169428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmqfm\" (UniqueName: \"kubernetes.io/projected/75e3c7d2-68ce-4691-bc46-123bbb333e3a-kube-api-access-dmqfm\") pod \"rate-test-model-e412c4-kserve-77d8958d7f-sb4pt\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") " pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.268610 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.268498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:55:58.541625 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:58.541598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"]
Sep 10 15:55:58.543509 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:55:58.543481    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75e3c7d2_68ce_4691_bc46_123bbb333e3a.slice/crio-1552406bf3605f37c7b2b68a156d4c68c4553b41c645f4e76afd9ea490b9b004 WatchSource:0}: Error finding container 1552406bf3605f37c7b2b68a156d4c68c4553b41c645f4e76afd9ea490b9b004: Status 404 returned error can't find the container with id 1552406bf3605f37c7b2b68a156d4c68c4553b41c645f4e76afd9ea490b9b004
Sep 10 15:55:59.195396 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:59.195344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt" event={"ID":"75e3c7d2-68ce-4691-bc46-123bbb333e3a","Type":"ContainerStarted","Data":"0c59c97ebbb26c9bd18ffb2d88c10db3bc3ea1678e016202237e7bc573698547"}
Sep 10 15:55:59.195396 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:59.195400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt" event={"ID":"75e3c7d2-68ce-4691-bc46-123bbb333e3a","Type":"ContainerStarted","Data":"1552406bf3605f37c7b2b68a156d4c68c4553b41c645f4e76afd9ea490b9b004"}
Sep 10 15:55:59.212599 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:55:59.212550    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt" podStartSLOduration=2.212534274 podStartE2EDuration="2.212534274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:55:59.211506425 +0000 UTC m=+1436.026582165" watchObservedRunningTime="2026-09-10 15:55:59.212534274 +0000 UTC m=+1436.027610004"
Sep 10 15:56:00.766239 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:00.766208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:00.866791 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:00.866755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:00.967372 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:00.967330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:01.076281 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:01.076186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:01.374358 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:01.374254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:04.853188 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:04.853149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:56:07.140501 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:07.140466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:07.201438 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:07.201389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:07.414483 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:07.414450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:07.926547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:07.926465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:08.269026 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:08.268898    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:56:08.269026 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:08.268954    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:56:08.281743 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:08.281715    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:56:09.264250 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:09.264213    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:56:16.127823 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:16.127789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:17.899890 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:17.899843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:23.480760 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.480725    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"]
Sep 10 15:56:23.481276 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.481025    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v" podUID="0bda0318-c147-4117-a6ed-077d4e0ae6d6" containerName="maas-api" containerID="cri-o://99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc" gracePeriod=30
Sep 10 15:56:23.509279 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.509248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:23.610826 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.610796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:23.690148 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.690114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:23.729276 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.729243    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:56:23.822904 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.822810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw5gz\" (UniqueName: \"kubernetes.io/projected/0bda0318-c147-4117-a6ed-077d4e0ae6d6-kube-api-access-kw5gz\") pod \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") "
Sep 10 15:56:23.823106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.822985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-metrics-certs\") pod \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") "
Sep 10 15:56:23.823106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.823033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bda0318-c147-4117-a6ed-077d4e0ae6d6-openshift-service-ca\") pod \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") "
Sep 10 15:56:23.823106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.823100    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-maas-api-tls\") pod \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\" (UID: \"0bda0318-c147-4117-a6ed-077d4e0ae6d6\") "
Sep 10 15:56:23.823456 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.823425    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bda0318-c147-4117-a6ed-077d4e0ae6d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0bda0318-c147-4117-a6ed-077d4e0ae6d6" (UID: "0bda0318-c147-4117-a6ed-077d4e0ae6d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:56:23.825199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.825172    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bda0318-c147-4117-a6ed-077d4e0ae6d6-kube-api-access-kw5gz" (OuterVolumeSpecName: "kube-api-access-kw5gz") pod "0bda0318-c147-4117-a6ed-077d4e0ae6d6" (UID: "0bda0318-c147-4117-a6ed-077d4e0ae6d6"). InnerVolumeSpecName "kube-api-access-kw5gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:56:23.825199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.825187    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0bda0318-c147-4117-a6ed-077d4e0ae6d6" (UID: "0bda0318-c147-4117-a6ed-077d4e0ae6d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:56:23.825370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.825322    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0bda0318-c147-4117-a6ed-077d4e0ae6d6" (UID: "0bda0318-c147-4117-a6ed-077d4e0ae6d6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:56:23.836213 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.836190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:23.924421 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.924381    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bda0318-c147-4117-a6ed-077d4e0ae6d6-openshift-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:23.924421 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.924409    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-maas-api-tls\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:23.924421 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.924418    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw5gz\" (UniqueName: \"kubernetes.io/projected/0bda0318-c147-4117-a6ed-077d4e0ae6d6-kube-api-access-kw5gz\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:23.924421 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:23.924426    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bda0318-c147-4117-a6ed-077d4e0ae6d6-metrics-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:24.160392 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.160354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:24.338338 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.338305    2565 generic.go:356] "Generic (PLEG): container finished" podID="0bda0318-c147-4117-a6ed-077d4e0ae6d6" containerID="99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc" exitCode=0
Sep 10 15:56:24.338506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.338349    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"
Sep 10 15:56:24.338506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.338349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v" event={"ID":"0bda0318-c147-4117-a6ed-077d4e0ae6d6","Type":"ContainerDied","Data":"99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc"}
Sep 10 15:56:24.338506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.338487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v" event={"ID":"0bda0318-c147-4117-a6ed-077d4e0ae6d6","Type":"ContainerDied","Data":"8533173d474a27fd33eac8b6d0a601f48471fb1079a6bae56bf30972b6a32e38"}
Sep 10 15:56:24.338621 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.338521    2565 scope.go:117] "RemoveContainer" containerID="99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc"
Sep 10 15:56:24.348001 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.347983    2565 scope.go:117] "RemoveContainer" containerID="99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc"
Sep 10 15:56:24.348278 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:56:24.348257    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc\": container with ID starting with 99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc not found: ID does not exist" containerID="99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc"
Sep 10 15:56:24.348345 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.348286    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc"} err="failed to get container status \"99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc\": rpc error: code = NotFound desc = could not find container \"99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc\": container with ID starting with 99ea4a9dd1dbaff49648b4683229f24da294819a06859399faf015bc0bfeeecc not found: ID does not exist"
Sep 10 15:56:24.356603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.356580    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"]
Sep 10 15:56:24.362911 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:24.362888    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86fc05-966d7d68d-87b9v"]
Sep 10 15:56:25.825522 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:25.825490    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bda0318-c147-4117-a6ed-077d4e0ae6d6" path="/var/lib/kubelet/pods/0bda0318-c147-4117-a6ed-077d4e0ae6d6/volumes"
Sep 10 15:56:26.045536 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:26.045497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:29.669707 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:29.669670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:29.768508 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:29.768465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:29.915402 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:29.915368    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"]
Sep 10 15:56:29.915582 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:29.915557    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy" containerID="cri-o://cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05" gracePeriod=30
Sep 10 15:56:29.930683 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:29.930605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:30.445930 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:30.445894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:56:30.501666 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:30.501630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:35.171228 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.171198    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:56:35.239056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.238952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-podinfo\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239017    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-credential-socket\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239053    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-token\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239067    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-data\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9tt2\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-kube-api-access-s9tt2\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239137    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-socket\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239187    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istiod-ca-cert\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-certs\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-envoy\") pod \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\" (UID: \"ab0cb6c0-a11b-41c5-a032-9f1224697a27\") "
Sep 10 15:56:35.239343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:35.239711 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239469    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:35.239711 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239536    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:35.239711 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239592    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:56:35.239892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239729    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.239892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239751    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.239892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239765    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.239892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239866    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:35.239892 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.239777    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.241424 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.241400    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:56:35.241544 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.241405    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:35.241613 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.241587    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:56:35.241613 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.241600    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-kube-api-access-s9tt2" (OuterVolumeSpecName: "kube-api-access-s9tt2") pod "ab0cb6c0-a11b-41c5-a032-9f1224697a27" (UID: "ab0cb6c0-a11b-41c5-a032-9f1224697a27"). InnerVolumeSpecName "kube-api-access-s9tt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:56:35.341358 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.341318    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.341358 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.341351    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.341358 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.341360    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.341601 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.341368    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9tt2\" (UniqueName: \"kubernetes.io/projected/ab0cb6c0-a11b-41c5-a032-9f1224697a27-kube-api-access-s9tt2\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.341601 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.341379    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0cb6c0-a11b-41c5-a032-9f1224697a27-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:35.408158 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.408125    2565 generic.go:356] "Generic (PLEG): container finished" podID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerID="cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05" exitCode=0
Sep 10 15:56:35.408329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.408171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" event={"ID":"ab0cb6c0-a11b-41c5-a032-9f1224697a27","Type":"ContainerDied","Data":"cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05"}
Sep 10 15:56:35.408329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.408211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4" event={"ID":"ab0cb6c0-a11b-41c5-a032-9f1224697a27","Type":"ContainerDied","Data":"032231bb38d76b32ee2885354961a2cefb06bc98b833c77336e47b5da284129a"}
Sep 10 15:56:35.408329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.408233    2565 scope.go:117] "RemoveContainer" containerID="cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05"
Sep 10 15:56:35.408329 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.408172    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"
Sep 10 15:56:35.418041 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.418026    2565 scope.go:117] "RemoveContainer" containerID="0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e"
Sep 10 15:56:35.426491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.426472    2565 scope.go:117] "RemoveContainer" containerID="cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05"
Sep 10 15:56:35.426795 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:56:35.426775    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05\": container with ID starting with cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05 not found: ID does not exist" containerID="cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05"
Sep 10 15:56:35.426848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.426807    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05"} err="failed to get container status \"cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05\": rpc error: code = NotFound desc = could not find container \"cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05\": container with ID starting with cb3568bbbfe973fc1f0bd62b59c7b14fcfc44a2a04c83760f796b3c77e6d3a05 not found: ID does not exist"
Sep 10 15:56:35.426848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.426825    2565 scope.go:117] "RemoveContainer" containerID="0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e"
Sep 10 15:56:35.427119 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:56:35.427080    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e\": container with ID starting with 0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e not found: ID does not exist" containerID="0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e"
Sep 10 15:56:35.427119 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.427107    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e"} err="failed to get container status \"0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e\": rpc error: code = NotFound desc = could not find container \"0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e\": container with ID starting with 0aa40a8494ca99c5cbf3e3def6256b24f02ce761316962e133075aec1c3c087e not found: ID does not exist"
Sep 10 15:56:35.430196 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.430173    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"]
Sep 10 15:56:35.433085 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.433065    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-86fc05-openshift-default-665f6ddf66-wvkv4"]
Sep 10 15:56:35.824809 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:35.824776    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" path="/var/lib/kubelet/pods/ab0cb6c0-a11b-41c5-a032-9f1224697a27/volumes"
Sep 10 15:56:41.034368 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:41.034234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:41.111557 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:41.111522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:41.212673 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:41.212639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:41.278669 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:41.278634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:41.605565 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:41.605529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:47.492646 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:47.492610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:47.593657 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:47.593621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:47.735426 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:47.735393    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"]
Sep 10 15:56:47.735680 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:47.735658    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy" containerID="cri-o://b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf" gracePeriod=30
Sep 10 15:56:47.760705 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:47.760640    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:48.216696 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:48.216662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:48.644275 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:48.644178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:56:52.543829 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:52.543793    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:52.990308 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:52.990286    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:56:53.010725 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.010698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-certs\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.010878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.010737    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-socket\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.010878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.010761    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-podinfo\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.010878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.010788    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-data\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.010878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.010851    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2489ca51-e18a-465c-889a-7a8fa82d6372-istiod-ca-cert\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.011147 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.010882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-token\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.011147 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.010920    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-credential-socket\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.011147 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.010970    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkdb2\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-kube-api-access-nkdb2\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.011147 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011023    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:53.011147 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011043    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-envoy\") pod \"2489ca51-e18a-465c-889a-7a8fa82d6372\" (UID: \"2489ca51-e18a-465c-889a-7a8fa82d6372\") "
Sep 10 15:56:53.011406 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011222    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:53.011406 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011300    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2489ca51-e18a-465c-889a-7a8fa82d6372-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:56:53.011586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011531    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-data" (OuterVolumeSpecName: "istio-data") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:53.011586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011547    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.011586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011570    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2489ca51-e18a-465c-889a-7a8fa82d6372-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.011586 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011585    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.011874 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.011604    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:53.013334 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.013310    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:56:53.013663 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.013626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:56:53.013757 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.013711    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-kube-api-access-nkdb2" (OuterVolumeSpecName: "kube-api-access-nkdb2") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "kube-api-access-nkdb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:56:53.013757 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.013732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-token" (OuterVolumeSpecName: "istio-token") pod "2489ca51-e18a-465c-889a-7a8fa82d6372" (UID: "2489ca51-e18a-465c-889a-7a8fa82d6372"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:56:53.112726 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.112656    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.112726 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.112681    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkdb2\" (UniqueName: \"kubernetes.io/projected/2489ca51-e18a-465c-889a-7a8fa82d6372-kube-api-access-nkdb2\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.112726 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.112691    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.112726 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.112702    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.112726 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.112710    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.112726 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.112718    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2489ca51-e18a-465c-889a-7a8fa82d6372-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:56:53.440293 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.440260    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"]
Sep 10 15:56:53.464603 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.464522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:53.510342 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.510314    2565 generic.go:356] "Generic (PLEG): container finished" podID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerID="b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf" exitCode=0
Sep 10 15:56:53.510506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.510356    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"
Sep 10 15:56:53.510506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.510408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" event={"ID":"2489ca51-e18a-465c-889a-7a8fa82d6372","Type":"ContainerDied","Data":"b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf"}
Sep 10 15:56:53.510506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.510457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl" event={"ID":"2489ca51-e18a-465c-889a-7a8fa82d6372","Type":"ContainerDied","Data":"b3da9ff743f6e06626918403d6ccdda33af33e4e6e10acc731ca39911ebf89c8"}
Sep 10 15:56:53.510506 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.510482    2565 scope.go:117] "RemoveContainer" containerID="b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf"
Sep 10 15:56:53.520199 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.520183    2565 scope.go:117] "RemoveContainer" containerID="af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca"
Sep 10 15:56:53.530694 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.530626    2565 scope.go:117] "RemoveContainer" containerID="b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf"
Sep 10 15:56:53.531539 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:56:53.531508    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf\": container with ID starting with b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf not found: ID does not exist" containerID="b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf"
Sep 10 15:56:53.531645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.531549    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf"} err="failed to get container status \"b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf\": rpc error: code = NotFound desc = could not find container \"b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf\": container with ID starting with b1bf76d1efa3378f2c63a5c84a09953089828e230fb08a362e8dcb2ba7a0efcf not found: ID does not exist"
Sep 10 15:56:53.531645 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.531573    2565 scope.go:117] "RemoveContainer" containerID="af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca"
Sep 10 15:56:53.532055 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:56:53.531922    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca\": container with ID starting with af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca not found: ID does not exist" containerID="af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca"
Sep 10 15:56:53.532055 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.531955    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca"} err="failed to get container status \"af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca\": rpc error: code = NotFound desc = could not find container \"af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca\": container with ID starting with af083b1f0fa013d34e645b72c438511061cc13028cc5c5d11897bafaff0dfeca not found: ID does not exist"
Sep 10 15:56:53.534435 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.534410    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"]
Sep 10 15:56:53.537953 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.537929    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e3dc2-openshift-default-7cbf4bd49b-9ffxl"]
Sep 10 15:56:53.824343 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.824263    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" path="/var/lib/kubelet/pods/2489ca51-e18a-465c-889a-7a8fa82d6372/volumes"
Sep 10 15:56:53.888564 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:53.888533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:54.195640 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:54.195600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:54.586897 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:54.586808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:56.811934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:56.811902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:56.910339 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:56.910305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:57.971211 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:57.971170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:58.071739 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:58.071701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:58.429802 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:58.429770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:58.542110 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:58.542076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:58.689451 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:58.689354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:58.822467 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:58.822436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:58.921850 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:58.921819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:59.021414 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:59.021318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:59.085789 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:59.085754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:56:59.422640 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:56:59.422605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:02.555253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:02.555211    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:57:03.401952 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:03.401906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:03.757001 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:03.756898    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:57:03.758308 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:03.758285    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 15:57:05.185358 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:05.185326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:05.285152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:05.285118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:05.415032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:05.414978    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"]
Sep 10 15:57:05.415282 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:05.415256    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy" containerID="cri-o://2dcc07123de83962bc28ff04d07776ae3e3fda6beed30f0d9ecfa5b89fd038ec" gracePeriod=30
Sep 10 15:57:05.444842 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:05.444746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:08.460131 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.460087    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt" podUID="75e3c7d2-68ce-4691-bc46-123bbb333e3a" containerName="main" containerID="cri-o://0c59c97ebbb26c9bd18ffb2d88c10db3bc3ea1678e016202237e7bc573698547" gracePeriod=45
Sep 10 15:57:08.592487 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.592459    2565 generic.go:356] "Generic (PLEG): container finished" podID="75e3c7d2-68ce-4691-bc46-123bbb333e3a" containerID="0c59c97ebbb26c9bd18ffb2d88c10db3bc3ea1678e016202237e7bc573698547" exitCode=0
Sep 10 15:57:08.592624 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.592533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt" event={"ID":"75e3c7d2-68ce-4691-bc46-123bbb333e3a","Type":"ContainerDied","Data":"0c59c97ebbb26c9bd18ffb2d88c10db3bc3ea1678e016202237e7bc573698547"}
Sep 10 15:57:08.711173 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.711118    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:57:08.858275 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858246    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-model-cache\") pod \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") "
Sep 10 15:57:08.858275 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tls-certs\") pod \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") "
Sep 10 15:57:08.858528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858303    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-home\") pod \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") "
Sep 10 15:57:08.858528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-dshm\") pod \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") "
Sep 10 15:57:08.858528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tmp-dir\") pod \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") "
Sep 10 15:57:08.858528 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858378    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmqfm\" (UniqueName: \"kubernetes.io/projected/75e3c7d2-68ce-4691-bc46-123bbb333e3a-kube-api-access-dmqfm\") pod \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\" (UID: \"75e3c7d2-68ce-4691-bc46-123bbb333e3a\") "
Sep 10 15:57:08.858756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858572    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "75e3c7d2-68ce-4691-bc46-123bbb333e3a" (UID: "75e3c7d2-68ce-4691-bc46-123bbb333e3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:08.858756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858606    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-home" (OuterVolumeSpecName: "home") pod "75e3c7d2-68ce-4691-bc46-123bbb333e3a" (UID: "75e3c7d2-68ce-4691-bc46-123bbb333e3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:08.858756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858642    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75e3c7d2-68ce-4691-bc46-123bbb333e3a" (UID: "75e3c7d2-68ce-4691-bc46-123bbb333e3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:08.858756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858718    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:08.858756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858732    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:08.858756 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.858744    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:08.860447 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.860425    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75e3c7d2-68ce-4691-bc46-123bbb333e3a" (UID: "75e3c7d2-68ce-4691-bc46-123bbb333e3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:57:08.860530 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.860489    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e3c7d2-68ce-4691-bc46-123bbb333e3a-kube-api-access-dmqfm" (OuterVolumeSpecName: "kube-api-access-dmqfm") pod "75e3c7d2-68ce-4691-bc46-123bbb333e3a" (UID: "75e3c7d2-68ce-4691-bc46-123bbb333e3a"). InnerVolumeSpecName "kube-api-access-dmqfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:57:08.860530 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.860510    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-dshm" (OuterVolumeSpecName: "dshm") pod "75e3c7d2-68ce-4691-bc46-123bbb333e3a" (UID: "75e3c7d2-68ce-4691-bc46-123bbb333e3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:08.960105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.960070    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75e3c7d2-68ce-4691-bc46-123bbb333e3a-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:08.960105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.960100    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75e3c7d2-68ce-4691-bc46-123bbb333e3a-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:08.960105 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:08.960110    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmqfm\" (UniqueName: \"kubernetes.io/projected/75e3c7d2-68ce-4691-bc46-123bbb333e3a-kube-api-access-dmqfm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:09.598532 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:09.598498    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"
Sep 10 15:57:09.598532 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:09.598510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt" event={"ID":"75e3c7d2-68ce-4691-bc46-123bbb333e3a","Type":"ContainerDied","Data":"1552406bf3605f37c7b2b68a156d4c68c4553b41c645f4e76afd9ea490b9b004"}
Sep 10 15:57:09.599090 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:09.598564    2565 scope.go:117] "RemoveContainer" containerID="0c59c97ebbb26c9bd18ffb2d88c10db3bc3ea1678e016202237e7bc573698547"
Sep 10 15:57:09.624425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:09.624402    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"]
Sep 10 15:57:09.626195 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:09.626172    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e412c4/rate-test-model-e412c4-kserve-77d8958d7f-sb4pt"]
Sep 10 15:57:09.824427 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:09.824396    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75e3c7d2-68ce-4691-bc46-123bbb333e3a" path="/var/lib/kubelet/pods/75e3c7d2-68ce-4691-bc46-123bbb333e3a/volumes"
Sep 10 15:57:10.609346 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.609315    2565 generic.go:356] "Generic (PLEG): container finished" podID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerID="2dcc07123de83962bc28ff04d07776ae3e3fda6beed30f0d9ecfa5b89fd038ec" exitCode=0
Sep 10 15:57:10.609663 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.609381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" event={"ID":"cdcf8b28-ba13-4672-814f-d092bc3d2565","Type":"ContainerDied","Data":"2dcc07123de83962bc28ff04d07776ae3e3fda6beed30f0d9ecfa5b89fd038ec"}
Sep 10 15:57:10.609663 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.609440    2565 scope.go:117] "RemoveContainer" containerID="73d59d80f2102d0787542fcb55ae3c030e7cda937c2e83d31ef1fda2d5ad87d1"
Sep 10 15:57:10.670876 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.670854    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:57:10.774388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdcf8b28-ba13-4672-814f-d092bc3d2565-istiod-ca-cert\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774347    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-credential-socket\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774384    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-token\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-podinfo\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774503    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-data\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psd74\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-kube-api-access-psd74\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774557    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-certs\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774637    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-envoy\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774671    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-socket\") pod \"cdcf8b28-ba13-4672-814f-d092bc3d2565\" (UID: \"cdcf8b28-ba13-4672-814f-d092bc3d2565\") "
Sep 10 15:57:10.774906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774683    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:10.774906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774700    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdcf8b28-ba13-4672-814f-d092bc3d2565-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:57:10.774906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-data" (OuterVolumeSpecName: "istio-data") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:10.775159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774932    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:10.775159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.774988    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:10.775159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.775048    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:10.775159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.775069    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:10.775159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.775085    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdcf8b28-ba13-4672-814f-d092bc3d2565-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:10.775159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.775099    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:10.776629 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.776608    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-token" (OuterVolumeSpecName: "istio-token") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:57:10.776801 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.776783    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:57:10.777180 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.777163    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:57:10.777241 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.777181    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-kube-api-access-psd74" (OuterVolumeSpecName: "kube-api-access-psd74") pod "cdcf8b28-ba13-4672-814f-d092bc3d2565" (UID: "cdcf8b28-ba13-4672-814f-d092bc3d2565"). InnerVolumeSpecName "kube-api-access-psd74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:57:10.876453 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.876422    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:10.876453 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.876452    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psd74\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-kube-api-access-psd74\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:10.876650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.876466    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:10.876650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.876478    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdcf8b28-ba13-4672-814f-d092bc3d2565-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:10.876650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:10.876490    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdcf8b28-ba13-4672-814f-d092bc3d2565-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:57:11.616559 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:11.616524    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"
Sep 10 15:57:11.617027 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:11.616580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g" event={"ID":"cdcf8b28-ba13-4672-814f-d092bc3d2565","Type":"ContainerDied","Data":"bbdf21af66d2a6abec2b2bbcca2f354a00c15dbc55bb132bb4439b1e51339ba9"}
Sep 10 15:57:11.617027 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:11.616648    2565 scope.go:117] "RemoveContainer" containerID="2dcc07123de83962bc28ff04d07776ae3e3fda6beed30f0d9ecfa5b89fd038ec"
Sep 10 15:57:11.637861 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:11.637827    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"]
Sep 10 15:57:11.641878 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:11.641856    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-761990-openshift-default-6f74c8f56-lrc4g"]
Sep 10 15:57:11.824548 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:11.824517    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" path="/var/lib/kubelet/pods/cdcf8b28-ba13-4672-814f-d092bc3d2565/volumes"
Sep 10 15:57:18.921934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:18.921890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:21.812413 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:21.812374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:22.515797 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.515765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:22.792330 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792256    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"]
Sep 10 15:57:22.792632 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792616    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy"
Sep 10 15:57:22.792697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792634    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy"
Sep 10 15:57:22.792697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792649    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy"
Sep 10 15:57:22.792697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792658    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy"
Sep 10 15:57:22.792697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792666    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy"
Sep 10 15:57:22.792697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792672    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy"
Sep 10 15:57:22.792697 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792698    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bda0318-c147-4117-a6ed-077d4e0ae6d6" containerName="maas-api"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792704    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bda0318-c147-4117-a6ed-077d4e0ae6d6" containerName="maas-api"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792714    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792721    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792732    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e3c7d2-68ce-4691-bc46-123bbb333e3a" containerName="main"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792737    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e3c7d2-68ce-4691-bc46-123bbb333e3a" containerName="main"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792802    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792811    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792817    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792823    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2489ca51-e18a-465c-889a-7a8fa82d6372" containerName="istio-proxy"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792830    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bda0318-c147-4117-a6ed-077d4e0ae6d6" containerName="maas-api"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792836    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy"
Sep 10 15:57:22.792954 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.792843    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="75e3c7d2-68ce-4691-bc46-123bbb333e3a" containerName="main"
Sep 10 15:57:22.797547 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.797527    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.800319 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.800298    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f52559-openshift-default-dockercfg-w522m\""
Sep 10 15:57:22.806804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.806782    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"]
Sep 10 15:57:22.825685 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.825648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:22.988421 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-credential-socket\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.988596 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952cc45d-21c7-417b-82b1-b09c671d2698-istiod-ca-cert\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.988596 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-istio-token\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.988702 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-data\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.988783 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-socket\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.988843 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvl5f\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-kube-api-access-fvl5f\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.988900 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-envoy\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.988900 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952cc45d-21c7-417b-82b1-b09c671d2698-istio-podinfo\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:22.989044 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:22.988914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-certs\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.042403 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.042315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:23.089822 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.089787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952cc45d-21c7-417b-82b1-b09c671d2698-istiod-ca-cert\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.089836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-istio-token\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.089869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-data\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.089908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-socket\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.089940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvl5f\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-kube-api-access-fvl5f\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.089995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-envoy\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090281 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.090022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952cc45d-21c7-417b-82b1-b09c671d2698-istio-podinfo\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090281 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.090045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-certs\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090281 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.090073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-credential-socket\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090436 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.090321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-data\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090507 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.090485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-credential-socket\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090560 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.090538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-socket\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090610 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.090540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-certs\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.090610 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.090598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952cc45d-21c7-417b-82b1-b09c671d2698-istiod-ca-cert\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.092466 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.092448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-envoy\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.092611 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.092594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952cc45d-21c7-417b-82b1-b09c671d2698-istio-podinfo\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.098093 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.098073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-istio-token\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.098860 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.098836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvl5f\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-kube-api-access-fvl5f\") pod \"e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") " pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.109848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.109818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:23.387517 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.387490    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"]
Sep 10 15:57:23.389496 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:57:23.389465    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952cc45d_21c7_417b_82b1_b09c671d2698.slice/crio-fe4de72d15f1d5613b5f60c468d77010fef257067cfe5113a827ab2034941ae2 WatchSource:0}: Error finding container fe4de72d15f1d5613b5f60c468d77010fef257067cfe5113a827ab2034941ae2: Status 404 returned error can't find the container with id fe4de72d15f1d5613b5f60c468d77010fef257067cfe5113a827ab2034941ae2
Sep 10 15:57:23.391672 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.391640    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:57:23.391754 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.391708    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:57:23.391754 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.391737    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:57:23.682152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.682118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" event={"ID":"952cc45d-21c7-417b-82b1-b09c671d2698","Type":"ContainerStarted","Data":"bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e"}
Sep 10 15:57:23.682351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.682170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" event={"ID":"952cc45d-21c7-417b-82b1-b09c671d2698","Type":"ContainerStarted","Data":"fe4de72d15f1d5613b5f60c468d77010fef257067cfe5113a827ab2034941ae2"}
Sep 10 15:57:23.704938 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:23.704885    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" podStartSLOduration=1.704871392 podStartE2EDuration="1.704871392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:23.702628341 +0000 UTC m=+1520.517704112" watchObservedRunningTime="2026-09-10 15:57:23.704871392 +0000 UTC m=+1520.519947131"
Sep 10 15:57:24.110703 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:24.110624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:24.115687 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:24.115663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:24.687106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:24.687073    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:24.688204 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:24.688186    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:26.380972 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:26.380876    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:26.481101 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:26.481062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:26.907742 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:26.907697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:27.008012 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:27.007975    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:27.263788 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:27.263699    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:27.369057 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:27.369018    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:27.459085 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:27.459051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:57:32.949464 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:32.949429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:57:43.804324 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:43.804290    2565 generic.go:356] "Generic (PLEG): container finished" podID="952cc45d-21c7-417b-82b1-b09c671d2698" containerID="bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e" exitCode=0
Sep 10 15:57:43.804741 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:43.804367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" event={"ID":"952cc45d-21c7-417b-82b1-b09c671d2698","Type":"ContainerDied","Data":"bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e"}
Sep 10 15:57:43.804785 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:43.804763    2565 scope.go:117] "RemoveContainer" containerID="bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e"
Sep 10 15:57:43.805794 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:43.805768    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:57:43.805858 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:43.805838    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:57:43.805898 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:43.805872    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:57:44.812340 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:44.812295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" event={"ID":"952cc45d-21c7-417b-82b1-b09c671d2698","Type":"ContainerStarted","Data":"ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552"}
Sep 10 15:57:45.110658 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:45.110562    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:45.110818 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:45.110784    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:57:45.110866 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:45.110846    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 10 15:57:46.110469 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:46.110433    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:57:46.110847 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:46.110491    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 10 15:57:47.111092 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:47.111053    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:57:47.111579 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:47.111118    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 10 15:57:48.110735 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:48.110695    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:57:48.110918 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:48.110766    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 10 15:57:49.110453 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:49.110416    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 10 15:57:49.110862 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:49.110500    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 10 15:57:50.227281 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:50.227243    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:50.227815 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:50.227676    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:50.228548 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:50.228529    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 15:57:50.638816 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:57:50.638723    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:03.928782 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:03.928745    2565 scope.go:117] "RemoveContainer" containerID="a64c868419d517f1b18f24d8b9f8f79fcd39b47b0e012f65eb7202446bd0b3e3"
Sep 10 15:58:03.938987 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:03.938950    2565 scope.go:117] "RemoveContainer" containerID="17f06798d7e0a145259b7d105ce1c4601ae86a0c754b48a739cfecb2c7d9d0bd"
Sep 10 15:58:03.947016 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:03.946996    2565 scope.go:117] "RemoveContainer" containerID="b6dd446341a056c04eae46b57b1c6abcd5940f424d6cb686e303a276bc716cf8"
Sep 10 15:58:03.955366 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:03.955345    2565 scope.go:117] "RemoveContainer" containerID="a95398efa74eb58e32c296ebabe1432536c746389950aa6195560fced12187c9"
Sep 10 15:58:03.963631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:03.963604    2565 scope.go:117] "RemoveContainer" containerID="7b21e51facb3ed06c0a171aa912a1ff41a0c4ddfa848336e096ec7ddfb76405f"
Sep 10 15:58:03.971901 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:03.971880    2565 scope.go:117] "RemoveContainer" containerID="5aad9d669a83509cf0a0feb10aad5f38e811d1269372184289e856eb8e764c03"
Sep 10 15:58:04.824811 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:04.824774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:12.542904 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.542865    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"]
Sep 10 15:58:12.543370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.543312    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy"
Sep 10 15:58:12.543370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.543325    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy"
Sep 10 15:58:12.543370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.543340    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy"
Sep 10 15:58:12.543370 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.543346    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0cb6c0-a11b-41c5-a032-9f1224697a27" containerName="istio-proxy"
Sep 10 15:58:12.543564 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.543426    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdcf8b28-ba13-4672-814f-d092bc3d2565" containerName="istio-proxy"
Sep 10 15:58:12.546618 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.546598    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.549159 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.549127    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a85a91\"/\"kube-root-ca.crt\""
Sep 10 15:58:12.550133 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.550108    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a85a91\"/\"ipp-route-a85a91-kserve-self-signed-certs\""
Sep 10 15:58:12.550263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.550146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a85a91\"/\"default-dockercfg-l7hdv\""
Sep 10 15:58:12.550263 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.550176    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a85a91\"/\"openshift-service-ca.crt\""
Sep 10 15:58:12.555106 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.554603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"]
Sep 10 15:58:12.559999 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.559955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-home\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.560110 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.560020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-tmp-dir\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.560110 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.560059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-dshm\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.560110 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.560088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-model-cache\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.560254 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.560233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p264p\" (UniqueName: \"kubernetes.io/projected/6554a892-b474-4484-b4e5-8ccefdd0ff48-kube-api-access-p264p\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.560293 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.560269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6554a892-b474-4484-b4e5-8ccefdd0ff48-tls-certs\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.569998 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.567570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:12.661567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.661523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p264p\" (UniqueName: \"kubernetes.io/projected/6554a892-b474-4484-b4e5-8ccefdd0ff48-kube-api-access-p264p\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.661567 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.661572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6554a892-b474-4484-b4e5-8ccefdd0ff48-tls-certs\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.661828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.661592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-home\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.661828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.661609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-tmp-dir\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.661828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.661628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-dshm\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.661828 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.661747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-model-cache\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.662086 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.662042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-tmp-dir\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.662144 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.662092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-home\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.662144 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.662115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-model-cache\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.664031 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.664012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-dshm\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.664212 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.664196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6554a892-b474-4484-b4e5-8ccefdd0ff48-tls-certs\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.669444 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.669419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p264p\" (UniqueName: \"kubernetes.io/projected/6554a892-b474-4484-b4e5-8ccefdd0ff48-kube-api-access-p264p\") pod \"ipp-route-a85a91-kserve-8647ddb7c5-hmf6b\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") " pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:12.857981 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:12.857862    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:13.130864 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:13.130837    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"]
Sep 10 15:58:13.133106 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:58:13.133074    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6554a892_b474_4484_b4e5_8ccefdd0ff48.slice/crio-113fc3d3040fe09c083134ffcea2769328ec8549de9df96481d2320c7db63255 WatchSource:0}: Error finding container 113fc3d3040fe09c083134ffcea2769328ec8549de9df96481d2320c7db63255: Status 404 returned error can't find the container with id 113fc3d3040fe09c083134ffcea2769328ec8549de9df96481d2320c7db63255
Sep 10 15:58:13.965631 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:13.965595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b" event={"ID":"6554a892-b474-4484-b4e5-8ccefdd0ff48","Type":"ContainerStarted","Data":"904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2"}
Sep 10 15:58:13.966035 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:13.965642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b" event={"ID":"6554a892-b474-4484-b4e5-8ccefdd0ff48","Type":"ContainerStarted","Data":"113fc3d3040fe09c083134ffcea2769328ec8549de9df96481d2320c7db63255"}
Sep 10 15:58:13.985148 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:13.985097    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b" podStartSLOduration=1.985081152 podStartE2EDuration="1.985081152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:58:13.983295015 +0000 UTC m=+1570.798370757" watchObservedRunningTime="2026-09-10 15:58:13.985081152 +0000 UTC m=+1570.800156930"
Sep 10 15:58:16.653867 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:16.653824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:58:22.858324 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:22.858258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:22.858324 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:22.858337    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:22.870839 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:22.870813    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:23.021142 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:23.021110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:58:30.253056 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:30.253013    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:58:33.228939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:33.228897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:33.285767 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:33.285734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:37.200318 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.200279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:37.473946 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.473865    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"]
Sep 10 15:58:37.477445 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.477425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.479848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.479821    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-7388f5-openshift-default-dockercfg-ttrrw\""
Sep 10 15:58:37.487184 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.487160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"]
Sep 10 15:58:37.499017 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.498987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:37.614118 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-data\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.614286 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-socket\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.614286 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-token\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.614286 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-podinfo\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.614286 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.614427 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-certs\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.614427 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-envoy\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.614491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-credential-socket\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.614491 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.614465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bghc5\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-kube-api-access-bghc5\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715261 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-certs\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715261 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-envoy\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-credential-socket\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghc5\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-kube-api-access-bghc5\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-data\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-socket\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-token\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715525 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-podinfo\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-certs\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.715848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.715792    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-credential-socket\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.716071 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.716001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-data\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.716140 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.716124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-socket\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.716292 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.716272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.717712 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.717688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-envoy\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.718010 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.717992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-podinfo\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.723383 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.723357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bghc5\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-kube-api-access-bghc5\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.723728 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.723708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-token\") pod \"e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") " pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:37.789138 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:37.789040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:38.062650 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:38.062618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"]
Sep 10 15:58:38.065423 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:58:38.065391    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4ef0c2_9ee4_409e_ba95_93f0eb58c3dc.slice/crio-eef59f986e368b5986ea43d5b0a0190fbe5e6a2f5937ec48fab69f77742671bf WatchSource:0}: Error finding container eef59f986e368b5986ea43d5b0a0190fbe5e6a2f5937ec48fab69f77742671bf: Status 404 returned error can't find the container with id eef59f986e368b5986ea43d5b0a0190fbe5e6a2f5937ec48fab69f77742671bf
Sep 10 15:58:38.067702 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:38.067670    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:58:38.067774 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:38.067739    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:58:38.067774 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:38.067766    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:58:38.089425 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:38.089398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" event={"ID":"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc","Type":"ContainerStarted","Data":"eef59f986e368b5986ea43d5b0a0190fbe5e6a2f5937ec48fab69f77742671bf"}
Sep 10 15:58:38.261429 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:38.261394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:39.096716 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:39.096671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" event={"ID":"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc","Type":"ContainerStarted","Data":"067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889"}
Sep 10 15:58:39.116489 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:39.116428    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" podStartSLOduration=2.11641158 podStartE2EDuration="2.11641158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:58:39.115020461 +0000 UTC m=+1595.930096199" watchObservedRunningTime="2026-09-10 15:58:39.11641158 +0000 UTC m=+1595.931487319"
Sep 10 15:58:39.789769 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:39.789736    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:39.795167 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:39.795142    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:40.102620 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:40.102531    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:40.103613 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:40.103595    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:58:41.023064 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:41.022955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:41.114970 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:41.114916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:42.276998 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.276954    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"]
Sep 10 15:58:42.280906 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.280882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.283367 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.283334    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 15:58:42.283481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.283335    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 15:58:42.283481 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.283372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-7388f5-serving-cert\""
Sep 10 15:58:42.284160 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.284139    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 15:58:42.284264 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.284159    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ql4pw\""
Sep 10 15:58:42.291717 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.291696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"]
Sep 10 15:58:42.313317 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.313284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:42.413609 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.413572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:42.463794 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.463760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.464000 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.463800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.464000 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.463825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mncdh\" (UniqueName: \"kubernetes.io/projected/b3a55346-21c1-4269-ac70-696d7962558c-kube-api-access-mncdh\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.464000 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.463856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a55346-21c1-4269-ac70-696d7962558c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.565308 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.565223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mncdh\" (UniqueName: \"kubernetes.io/projected/b3a55346-21c1-4269-ac70-696d7962558c-kube-api-access-mncdh\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.565308 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.565260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a55346-21c1-4269-ac70-696d7962558c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.565502 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.565358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.565502 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.565382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.565570 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:58:42.565510    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-serving-cert: secret "maas-api-e2e-ipp-cleanup-7388f5-serving-cert" not found
Sep 10 15:58:42.565615 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:58:42.565602    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls podName:b3a55346-21c1-4269-ac70-696d7962558c nodeName:}" failed. No retries permitted until 2026-09-10 15:58:43.065579476 +0000 UTC m=+1599.880655211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn" (UID: "b3a55346-21c1-4269-ac70-696d7962558c") : secret "maas-api-e2e-ipp-cleanup-7388f5-serving-cert" not found
Sep 10 15:58:42.566110 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.566092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a55346-21c1-4269-ac70-696d7962558c-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.567904 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.567881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.572819 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.572802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mncdh\" (UniqueName: \"kubernetes.io/projected/b3a55346-21c1-4269-ac70-696d7962558c-kube-api-access-mncdh\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:42.718583 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.718548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:42.818796 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.818690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:42.881406 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:42.881371    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:58:43.071540 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:43.071438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:43.073813 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:43.073793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:43.194622 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:43.194584    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:43.467257 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:43.467227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"]
Sep 10 15:58:43.470122 ip-10-0-136-122 kubenswrapper[2565]: W0910 15:58:43.470096    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a55346_21c1_4269_ac70_696d7962558c.slice/crio-fc3e75a0c884974cce2bc679484938e2a21c6861c9a34e56d39c557e63d18343 WatchSource:0}: Error finding container fc3e75a0c884974cce2bc679484938e2a21c6861c9a34e56d39c557e63d18343: Status 404 returned error can't find the container with id fc3e75a0c884974cce2bc679484938e2a21c6861c9a34e56d39c557e63d18343
Sep 10 15:58:44.124726 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:44.124689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn" event={"ID":"b3a55346-21c1-4269-ac70-696d7962558c","Type":"ContainerStarted","Data":"fc3e75a0c884974cce2bc679484938e2a21c6861c9a34e56d39c557e63d18343"}
Sep 10 15:58:45.131693 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:45.131659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn" event={"ID":"b3a55346-21c1-4269-ac70-696d7962558c","Type":"ContainerStarted","Data":"4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35"}
Sep 10 15:58:45.132215 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:45.131723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:58:49.258409 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:49.258350    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn" podStartSLOduration=6.561284959 podStartE2EDuration="7.258330581s" totalImagesPullingTime="697.045622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:58:45.147673083 +0000 UTC m=+1601.962748826" watchObservedRunningTime="2026-09-10 15:58:49.258330581 +0000 UTC m=+1606.073406321"
Sep 10 15:58:49.258817 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:49.258779    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:58:51.146351 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:58:51.146308    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:59:00.222577 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:00.222544    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerID="067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889" exitCode=0
Sep 10 15:59:00.223023 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:00.222614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" event={"ID":"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc","Type":"ContainerDied","Data":"067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889"}
Sep 10 15:59:00.223089 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:00.223074    2565 scope.go:117] "RemoveContainer" containerID="067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889"
Sep 10 15:59:00.224181 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:00.224148    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:59:00.224253 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:00.224223    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:59:00.224296 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:00.224257    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 10 15:59:01.229931 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:01.229895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" event={"ID":"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc","Type":"ContainerStarted","Data":"7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a"}
Sep 10 15:59:01.790027 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:01.789991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:59:01.790227 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:01.790178    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 15:59:01.790281 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:01.790236    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 15:59:02.790016 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:02.789942    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 15:59:02.790419 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:02.790055    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 15:59:03.789674 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:03.789622    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 15:59:03.789865 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:03.789703    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 15:59:04.789738 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:04.789696    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 15:59:04.790177 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:04.789758    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 15:59:05.790520 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:05.790468    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 10 15:59:05.790920 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:05.790550    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 10 15:59:06.071982 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:06.071863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:06.793992 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:06.793947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:59:06.794397 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:06.794345    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:59:06.795129 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:06.795109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:59:12.871730 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:12.871692    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"]
Sep 10 15:59:12.872235 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:12.871923    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn" podUID="b3a55346-21c1-4269-ac70-696d7962558c" containerName="maas-api" containerID="cri-o://4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35" gracePeriod=30
Sep 10 15:59:12.900399 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:12.900356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:12.973331 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:12.973297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:13.036508 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.036471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:13.096769 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.096736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:13.117625 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.117602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:59:13.297763 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.297723    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-metrics-certs\") pod \"b3a55346-21c1-4269-ac70-696d7962558c\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") "
Sep 10 15:59:13.297948 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.297841    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls\") pod \"b3a55346-21c1-4269-ac70-696d7962558c\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") "
Sep 10 15:59:13.298032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.297972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a55346-21c1-4269-ac70-696d7962558c-openshift-service-ca\") pod \"b3a55346-21c1-4269-ac70-696d7962558c\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") "
Sep 10 15:59:13.298032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.298007    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mncdh\" (UniqueName: \"kubernetes.io/projected/b3a55346-21c1-4269-ac70-696d7962558c-kube-api-access-mncdh\") pod \"b3a55346-21c1-4269-ac70-696d7962558c\" (UID: \"b3a55346-21c1-4269-ac70-696d7962558c\") "
Sep 10 15:59:13.298387 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.298350    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a55346-21c1-4269-ac70-696d7962558c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3a55346-21c1-4269-ac70-696d7962558c" (UID: "b3a55346-21c1-4269-ac70-696d7962558c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:59:13.300034 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.300005    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b3a55346-21c1-4269-ac70-696d7962558c" (UID: "b3a55346-21c1-4269-ac70-696d7962558c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:59:13.300155 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.300115    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3a55346-21c1-4269-ac70-696d7962558c" (UID: "b3a55346-21c1-4269-ac70-696d7962558c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:59:13.300210 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.300178    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a55346-21c1-4269-ac70-696d7962558c-kube-api-access-mncdh" (OuterVolumeSpecName: "kube-api-access-mncdh") pod "b3a55346-21c1-4269-ac70-696d7962558c" (UID: "b3a55346-21c1-4269-ac70-696d7962558c"). InnerVolumeSpecName "kube-api-access-mncdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:59:13.301025 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.301003    2565 generic.go:356] "Generic (PLEG): container finished" podID="b3a55346-21c1-4269-ac70-696d7962558c" containerID="4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35" exitCode=0
Sep 10 15:59:13.301102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.301053    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"
Sep 10 15:59:13.301102 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.301083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn" event={"ID":"b3a55346-21c1-4269-ac70-696d7962558c","Type":"ContainerDied","Data":"4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35"}
Sep 10 15:59:13.301192 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.301140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn" event={"ID":"b3a55346-21c1-4269-ac70-696d7962558c","Type":"ContainerDied","Data":"fc3e75a0c884974cce2bc679484938e2a21c6861c9a34e56d39c557e63d18343"}
Sep 10 15:59:13.301192 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.301169    2565 scope.go:117] "RemoveContainer" containerID="4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35"
Sep 10 15:59:13.323813 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.323790    2565 scope.go:117] "RemoveContainer" containerID="4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35"
Sep 10 15:59:13.324151 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:59:13.324127    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35\": container with ID starting with 4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35 not found: ID does not exist" containerID="4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35"
Sep 10 15:59:13.324236 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.324163    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35"} err="failed to get container status \"4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35\": rpc error: code = NotFound desc = could not find container \"4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35\": container with ID starting with 4fdeb9bf604a19d65a64158a68bb11d96f12cb0b24316b63211e24fcc82a1f35 not found: ID does not exist"
Sep 10 15:59:13.333354 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.333329    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"]
Sep 10 15:59:13.338839 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.338814    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7388f5-67f9b5ddc4-vfdsn"]
Sep 10 15:59:13.399004 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.398941    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-metrics-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:13.399004 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.398999    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3a55346-21c1-4269-ac70-696d7962558c-maas-api-tls\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:13.399004 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.399009    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3a55346-21c1-4269-ac70-696d7962558c-openshift-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:13.399233 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.399019    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mncdh\" (UniqueName: \"kubernetes.io/projected/b3a55346-21c1-4269-ac70-696d7962558c-kube-api-access-mncdh\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:13.444484 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.444440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:13.824764 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:13.824729    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3a55346-21c1-4269-ac70-696d7962558c" path="/var/lib/kubelet/pods/b3a55346-21c1-4269-ac70-696d7962558c/volumes"
Sep 10 15:59:17.246941 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:17.246904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:59:19.146082 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:19.146042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:19.254593 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:19.254547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:19.394939 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:19.394903    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"]
Sep 10 15:59:19.395483 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:19.395444    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy" containerID="cri-o://7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a" gracePeriod=30
Sep 10 15:59:19.416390 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:19.416357    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:21.796590 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:21.796553    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 15:59:21.797014 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:21.796616    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 15:59:23.209897 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:23.209867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:24.650146 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.650122    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:59:24.705214 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-token\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705214 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705185    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-certs\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-socket\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-envoy\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705334    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-credential-socket\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705388 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-data\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bghc5\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-kube-api-access-bghc5\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-podinfo\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istiod-ca-cert\") pod \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\" (UID: \"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc\") "
Sep 10 15:59:24.705574 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:24.705787 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705563    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:24.705879 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705858    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:24.706080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.706058    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:24.706080 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705871    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:24.706227 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705926    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:24.706227 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.705935    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 15:59:24.707439 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.707416    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:59:24.707530 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.707437    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:24.707934 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.707912    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 15:59:24.708032 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.707936    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-kube-api-access-bghc5" (OuterVolumeSpecName: "kube-api-access-bghc5") pod "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" (UID: "7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc"). InnerVolumeSpecName "kube-api-access-bghc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:59:24.807601 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.807561    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:24.807601 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.807596    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bghc5\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-kube-api-access-bghc5\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:24.807601 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.807607    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:24.807848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.807616    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:24.807848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.807625    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:24.807848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.807632    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:24.807848 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:24.807640    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:25.364880 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.364837    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerID="7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a" exitCode=0
Sep 10 15:59:25.365075 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.364904    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"
Sep 10 15:59:25.365075 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.364922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" event={"ID":"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc","Type":"ContainerDied","Data":"7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a"}
Sep 10 15:59:25.365075 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.365017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq" event={"ID":"7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc","Type":"ContainerDied","Data":"eef59f986e368b5986ea43d5b0a0190fbe5e6a2f5937ec48fab69f77742671bf"}
Sep 10 15:59:25.365075 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.365041    2565 scope.go:117] "RemoveContainer" containerID="7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a"
Sep 10 15:59:25.374776 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.374761    2565 scope.go:117] "RemoveContainer" containerID="067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889"
Sep 10 15:59:25.383029 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.383003    2565 scope.go:117] "RemoveContainer" containerID="7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a"
Sep 10 15:59:25.383302 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:59:25.383281    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a\": container with ID starting with 7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a not found: ID does not exist" containerID="7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a"
Sep 10 15:59:25.383369 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.383313    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a"} err="failed to get container status \"7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a\": rpc error: code = NotFound desc = could not find container \"7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a\": container with ID starting with 7689a87a076a9917b44498a0e9810c2709e0f7ee6a4d54580bcbf6e67af26d0a not found: ID does not exist"
Sep 10 15:59:25.383369 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.383337    2565 scope.go:117] "RemoveContainer" containerID="067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889"
Sep 10 15:59:25.383601 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:59:25.383583    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889\": container with ID starting with 067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889 not found: ID does not exist" containerID="067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889"
Sep 10 15:59:25.383652 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.383607    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889"} err="failed to get container status \"067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889\": rpc error: code = NotFound desc = could not find container \"067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889\": container with ID starting with 067167cd4c8238165e8bbae395b85045d8ad06a549f0ca8a525370a6f49bf889 not found: ID does not exist"
Sep 10 15:59:25.386230 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.386209    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"]
Sep 10 15:59:25.389708 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.389687    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7388f5-openshift-default-6d987df674-k6cjq"]
Sep 10 15:59:25.824745 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:25.824712    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" path="/var/lib/kubelet/pods/7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc/volumes"
Sep 10 15:59:36.246545 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:36.246506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:59:38.559773 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:38.559732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:38.657026 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:38.656992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:38.757103 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:38.757039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:38.820891 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:38.820802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:39.162152 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:39.162117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:44.143850 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:44.143806    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"]
Sep 10 15:59:44.189575 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:44.189540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:49.446577 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:49.446540    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 15:59:58.400204 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:58.400168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 15:59:59.163453 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.163408    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b" podUID="6554a892-b474-4484-b4e5-8ccefdd0ff48" containerName="main" containerID="cri-o://904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2" gracePeriod=45
Sep 10 15:59:59.418299 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.418227    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:59:59.449182 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449154    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p264p\" (UniqueName: \"kubernetes.io/projected/6554a892-b474-4484-b4e5-8ccefdd0ff48-kube-api-access-p264p\") pod \"6554a892-b474-4484-b4e5-8ccefdd0ff48\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") "
Sep 10 15:59:59.449387 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-dshm\") pod \"6554a892-b474-4484-b4e5-8ccefdd0ff48\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") "
Sep 10 15:59:59.449387 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-home\") pod \"6554a892-b474-4484-b4e5-8ccefdd0ff48\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") "
Sep 10 15:59:59.449387 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449352    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-model-cache\") pod \"6554a892-b474-4484-b4e5-8ccefdd0ff48\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") "
Sep 10 15:59:59.449562 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449396    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-tmp-dir\") pod \"6554a892-b474-4484-b4e5-8ccefdd0ff48\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") "
Sep 10 15:59:59.449562 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449435    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6554a892-b474-4484-b4e5-8ccefdd0ff48-tls-certs\") pod \"6554a892-b474-4484-b4e5-8ccefdd0ff48\" (UID: \"6554a892-b474-4484-b4e5-8ccefdd0ff48\") "
Sep 10 15:59:59.449659 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449603    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-home" (OuterVolumeSpecName: "home") pod "6554a892-b474-4484-b4e5-8ccefdd0ff48" (UID: "6554a892-b474-4484-b4e5-8ccefdd0ff48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:59.449804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-model-cache" (OuterVolumeSpecName: "model-cache") pod "6554a892-b474-4484-b4e5-8ccefdd0ff48" (UID: "6554a892-b474-4484-b4e5-8ccefdd0ff48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:59.450013 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449829    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:59.450099 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.449945    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6554a892-b474-4484-b4e5-8ccefdd0ff48" (UID: "6554a892-b474-4484-b4e5-8ccefdd0ff48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:59.451893 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.451861    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554a892-b474-4484-b4e5-8ccefdd0ff48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6554a892-b474-4484-b4e5-8ccefdd0ff48" (UID: "6554a892-b474-4484-b4e5-8ccefdd0ff48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 15:59:59.452004 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.451922    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-dshm" (OuterVolumeSpecName: "dshm") pod "6554a892-b474-4484-b4e5-8ccefdd0ff48" (UID: "6554a892-b474-4484-b4e5-8ccefdd0ff48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 15:59:59.452004 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.451941    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6554a892-b474-4484-b4e5-8ccefdd0ff48-kube-api-access-p264p" (OuterVolumeSpecName: "kube-api-access-p264p") pod "6554a892-b474-4484-b4e5-8ccefdd0ff48" (UID: "6554a892-b474-4484-b4e5-8ccefdd0ff48"). InnerVolumeSpecName "kube-api-access-p264p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 15:59:59.548053 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.548014    2565 generic.go:356] "Generic (PLEG): container finished" podID="6554a892-b474-4484-b4e5-8ccefdd0ff48" containerID="904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2" exitCode=0
Sep 10 15:59:59.548053 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.548055    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"
Sep 10 15:59:59.548290 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.548081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b" event={"ID":"6554a892-b474-4484-b4e5-8ccefdd0ff48","Type":"ContainerDied","Data":"904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2"}
Sep 10 15:59:59.548290 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.548114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b" event={"ID":"6554a892-b474-4484-b4e5-8ccefdd0ff48","Type":"ContainerDied","Data":"113fc3d3040fe09c083134ffcea2769328ec8549de9df96481d2320c7db63255"}
Sep 10 15:59:59.548290 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.548131    2565 scope.go:117] "RemoveContainer" containerID="904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2"
Sep 10 15:59:59.550494 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.550476    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:59.550585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.550495    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:59.550585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.550506    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6554a892-b474-4484-b4e5-8ccefdd0ff48-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:59.550585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.550514    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6554a892-b474-4484-b4e5-8ccefdd0ff48-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:59.550585 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.550522    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p264p\" (UniqueName: \"kubernetes.io/projected/6554a892-b474-4484-b4e5-8ccefdd0ff48-kube-api-access-p264p\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 15:59:59.557530 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.557514    2565 scope.go:117] "RemoveContainer" containerID="904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2"
Sep 10 15:59:59.557811 ip-10-0-136-122 kubenswrapper[2565]: E0910 15:59:59.557790    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2\": container with ID starting with 904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2 not found: ID does not exist" containerID="904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2"
Sep 10 15:59:59.557882 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.557824    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2"} err="failed to get container status \"904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2\": rpc error: code = NotFound desc = could not find container \"904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2\": container with ID starting with 904437f36bd319f544b0b0cb6607d0a5ae34fb7755c95c65474bf0f7be8a7dc2 not found: ID does not exist"
Sep 10 15:59:59.568804 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.568776    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"]
Sep 10 15:59:59.572042 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.572018    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-a85a91/ipp-route-a85a91-kserve-8647ddb7c5-hmf6b"]
Sep 10 15:59:59.823904 ip-10-0-136-122 kubenswrapper[2565]: I0910 15:59:59.823815    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6554a892-b474-4484-b4e5-8ccefdd0ff48" path="/var/lib/kubelet/pods/6554a892-b474-4484-b4e5-8ccefdd0ff48/volumes"
Sep 10 16:00:00.139556 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.139458    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q"]
Sep 10 16:00:00.140385 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140356    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy"
Sep 10 16:00:00.140385 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140386    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy"
Sep 10 16:00:00.140864 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140406    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a55346-21c1-4269-ac70-696d7962558c" containerName="maas-api"
Sep 10 16:00:00.140864 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140416    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a55346-21c1-4269-ac70-696d7962558c" containerName="maas-api"
Sep 10 16:00:00.140864 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140462    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6554a892-b474-4484-b4e5-8ccefdd0ff48" containerName="main"
Sep 10 16:00:00.140864 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140472    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6554a892-b474-4484-b4e5-8ccefdd0ff48" containerName="main"
Sep 10 16:00:00.140864 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140705    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy"
Sep 10 16:00:00.140864 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140730    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy"
Sep 10 16:00:00.140864 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140744    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6554a892-b474-4484-b4e5-8ccefdd0ff48" containerName="main"
Sep 10 16:00:00.140864 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.140761    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a55346-21c1-4269-ac70-696d7962558c" containerName="maas-api"
Sep 10 16:00:00.146629 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.146606    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"]
Sep 10 16:00:00.147190 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.147142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q"
Sep 10 16:00:00.147327 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.147270    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy"
Sep 10 16:00:00.147327 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.147290    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4ef0c2-9ee4-409e-ba95-93f0eb58c3dc" containerName="istio-proxy"
Sep 10 16:00:00.150069 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.150016    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vzj4n\""
Sep 10 16:00:00.150996 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.150772    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q"]
Sep 10 16:00:00.150996 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.150890    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"
Sep 10 16:00:00.157109 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.157087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"]
Sep 10 16:00:00.163182 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.163161    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q"
Sep 10 16:00:00.170014 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.169998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"
Sep 10 16:00:00.436678 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.436646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q"]
Sep 10 16:00:00.438879 ip-10-0-136-122 kubenswrapper[2565]: W0910 16:00:00.438854    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f62147_7227_45a1_8449_c181822e66e1.slice/crio-b5771d0f297a3c8266af0d75a29e56e2fc7a45fdbd960f8161110366afdc240e WatchSource:0}: Error finding container b5771d0f297a3c8266af0d75a29e56e2fc7a45fdbd960f8161110366afdc240e: Status 404 returned error can't find the container with id b5771d0f297a3c8266af0d75a29e56e2fc7a45fdbd960f8161110366afdc240e
Sep 10 16:00:00.448350 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.448330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"]
Sep 10 16:00:00.452389 ip-10-0-136-122 kubenswrapper[2565]: W0910 16:00:00.452366    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47bcab38_b27a_4f67_b6f4_c73216149bec.slice/crio-af97f1a9aeab3248861593b0e1738878998ae33626f273afd85c84c0bfb4e2c1 WatchSource:0}: Error finding container af97f1a9aeab3248861593b0e1738878998ae33626f273afd85c84c0bfb4e2c1: Status 404 returned error can't find the container with id af97f1a9aeab3248861593b0e1738878998ae33626f273afd85c84c0bfb4e2c1
Sep 10 16:00:00.555314 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.555275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6" event={"ID":"47bcab38-b27a-4f67-b6f4-c73216149bec","Type":"ContainerStarted","Data":"af97f1a9aeab3248861593b0e1738878998ae33626f273afd85c84c0bfb4e2c1"}
Sep 10 16:00:00.556485 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:00.556455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q" event={"ID":"d9f62147-7227-45a1-8449-c181822e66e1","Type":"ContainerStarted","Data":"b5771d0f297a3c8266af0d75a29e56e2fc7a45fdbd960f8161110366afdc240e"}
Sep 10 16:00:01.563405 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:01.563373    2565 generic.go:356] "Generic (PLEG): container finished" podID="47bcab38-b27a-4f67-b6f4-c73216149bec" containerID="5ea1b6f1a0424227aaa1c7cdaffc6a4a132b6795e03ef73bdecd90406b5e25da" exitCode=0
Sep 10 16:00:01.563847 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:01.563457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6" event={"ID":"47bcab38-b27a-4f67-b6f4-c73216149bec","Type":"ContainerDied","Data":"5ea1b6f1a0424227aaa1c7cdaffc6a4a132b6795e03ef73bdecd90406b5e25da"}
Sep 10 16:00:01.565102 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:01.565081    2565 generic.go:356] "Generic (PLEG): container finished" podID="d9f62147-7227-45a1-8449-c181822e66e1" containerID="77dc61a9f190fbdd24509fdaf7db2a39b38b650ffda7ac9c8a47723d62780033" exitCode=0
Sep 10 16:00:01.565217 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:01.565121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q" event={"ID":"d9f62147-7227-45a1-8449-c181822e66e1","Type":"ContainerDied","Data":"77dc61a9f190fbdd24509fdaf7db2a39b38b650ffda7ac9c8a47723d62780033"}
Sep 10 16:00:02.694691 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:02.694664    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q"
Sep 10 16:00:02.731320 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:02.731292    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"
Sep 10 16:00:03.577389 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:03.577356    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"
Sep 10 16:00:03.577389 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:03.577376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6" event={"ID":"47bcab38-b27a-4f67-b6f4-c73216149bec","Type":"ContainerDied","Data":"af97f1a9aeab3248861593b0e1738878998ae33626f273afd85c84c0bfb4e2c1"}
Sep 10 16:00:03.577630 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:03.577425    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af97f1a9aeab3248861593b0e1738878998ae33626f273afd85c84c0bfb4e2c1"
Sep 10 16:00:03.578753 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:03.578726    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q"
Sep 10 16:00:03.578879 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:03.578728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817600-kh64q" event={"ID":"d9f62147-7227-45a1-8449-c181822e66e1","Type":"ContainerDied","Data":"b5771d0f297a3c8266af0d75a29e56e2fc7a45fdbd960f8161110366afdc240e"}
Sep 10 16:00:03.578879 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:03.578839    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5771d0f297a3c8266af0d75a29e56e2fc7a45fdbd960f8161110366afdc240e"
Sep 10 16:00:20.302778 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:20.302734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:21.268686 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:21.268647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:26.730889 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:26.730806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:26.887844 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:26.887803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:27.087982 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.087875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:27.458502 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.458465    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"]
Sep 10 16:00:27.458956 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.458938    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47bcab38-b27a-4f67-b6f4-c73216149bec" containerName="cleanup"
Sep 10 16:00:27.459025 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.458970    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="47bcab38-b27a-4f67-b6f4-c73216149bec" containerName="cleanup"
Sep 10 16:00:27.459025 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.458993    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9f62147-7227-45a1-8449-c181822e66e1" containerName="cleanup"
Sep 10 16:00:27.459025 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.459000    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9f62147-7227-45a1-8449-c181822e66e1" containerName="cleanup"
Sep 10 16:00:27.459133 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.459070    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9f62147-7227-45a1-8449-c181822e66e1" containerName="cleanup"
Sep 10 16:00:27.459133 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.459081    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="47bcab38-b27a-4f67-b6f4-c73216149bec" containerName="cleanup"
Sep 10 16:00:27.462319 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.462301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"
Sep 10 16:00:27.464781 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.464759    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 16:00:27.464891 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.464828    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vzj4n\""
Sep 10 16:00:27.472102 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.472076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"]
Sep 10 16:00:27.615463 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.615432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fab1958-c1bd-47d2-b31b-270c008a192e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2\" (UID: \"7fab1958-c1bd-47d2-b31b-270c008a192e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"
Sep 10 16:00:27.707279 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.707247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:27.716385 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.716314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fab1958-c1bd-47d2-b31b-270c008a192e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2\" (UID: \"7fab1958-c1bd-47d2-b31b-270c008a192e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"
Sep 10 16:00:27.716894 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.716875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fab1958-c1bd-47d2-b31b-270c008a192e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2\" (UID: \"7fab1958-c1bd-47d2-b31b-270c008a192e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"
Sep 10 16:00:27.775628 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:27.775596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"
Sep 10 16:00:28.048836 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:28.048809    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"]
Sep 10 16:00:28.050704 ip-10-0-136-122 kubenswrapper[2565]: W0910 16:00:28.050674    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fab1958_c1bd_47d2_b31b_270c008a192e.slice/crio-5749dce128b828bc33fb623bcaa11242750b25aa6a6fb63cf4aec87d1098d0bb WatchSource:0}: Error finding container 5749dce128b828bc33fb623bcaa11242750b25aa6a6fb63cf4aec87d1098d0bb: Status 404 returned error can't find the container with id 5749dce128b828bc33fb623bcaa11242750b25aa6a6fb63cf4aec87d1098d0bb
Sep 10 16:00:28.706034 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:28.705996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2" event={"ID":"7fab1958-c1bd-47d2-b31b-270c008a192e","Type":"ContainerStarted","Data":"939eabb5ceaccf08c1b3d21bb27f45c600e77a6a203e4a003386f6128d36bd1e"}
Sep 10 16:00:28.706215 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:28.706057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2" event={"ID":"7fab1958-c1bd-47d2-b31b-270c008a192e","Type":"ContainerStarted","Data":"5749dce128b828bc33fb623bcaa11242750b25aa6a6fb63cf4aec87d1098d0bb"}
Sep 10 16:00:28.721457 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:28.721400    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2" podStartSLOduration=1.721384308 podStartE2EDuration="1.721384308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:00:28.718877685 +0000 UTC m=+1705.533953425" watchObservedRunningTime="2026-09-10 16:00:28.721384308 +0000 UTC m=+1705.536460042"
Sep 10 16:00:29.712787 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:29.712750    2565 generic.go:356] "Generic (PLEG): container finished" podID="7fab1958-c1bd-47d2-b31b-270c008a192e" containerID="939eabb5ceaccf08c1b3d21bb27f45c600e77a6a203e4a003386f6128d36bd1e" exitCode=0
Sep 10 16:00:29.713243 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:29.712836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2" event={"ID":"7fab1958-c1bd-47d2-b31b-270c008a192e","Type":"ContainerDied","Data":"939eabb5ceaccf08c1b3d21bb27f45c600e77a6a203e4a003386f6128d36bd1e"}
Sep 10 16:00:30.853758 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:30.853730    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"
Sep 10 16:00:30.946728 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:30.946693    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fab1958-c1bd-47d2-b31b-270c008a192e-maas-api-service-ca\") pod \"7fab1958-c1bd-47d2-b31b-270c008a192e\" (UID: \"7fab1958-c1bd-47d2-b31b-270c008a192e\") "
Sep 10 16:00:30.947113 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:30.947088    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fab1958-c1bd-47d2-b31b-270c008a192e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7fab1958-c1bd-47d2-b31b-270c008a192e" (UID: "7fab1958-c1bd-47d2-b31b-270c008a192e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:00:31.047443 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:31.047348    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fab1958-c1bd-47d2-b31b-270c008a192e-maas-api-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:31.725569 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:31.725533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2" event={"ID":"7fab1958-c1bd-47d2-b31b-270c008a192e","Type":"ContainerDied","Data":"5749dce128b828bc33fb623bcaa11242750b25aa6a6fb63cf4aec87d1098d0bb"}
Sep 10 16:00:31.725569 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:31.725568    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"
Sep 10 16:00:31.725775 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:31.725583    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5749dce128b828bc33fb623bcaa11242750b25aa6a6fb63cf4aec87d1098d0bb"
Sep 10 16:00:37.913172 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:37.913137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:37.981679 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:37.981647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:38.079254 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:38.079219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:38.109319 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:38.109291    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"]
Sep 10 16:00:38.111891 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:38.111865    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f52559-nzhc2"]
Sep 10 16:00:38.136481 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:38.136458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:38.485625 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:38.485592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:39.823609 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:39.823577    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fab1958-c1bd-47d2-b31b-270c008a192e" path="/var/lib/kubelet/pods/7fab1958-c1bd-47d2-b31b-270c008a192e/volumes"
Sep 10 16:00:40.945917 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:40.945813    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:00:44.085823 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:44.085783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:44.186178 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:44.186138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:44.330129 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:44.330097    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"]
Sep 10 16:00:44.330369 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:44.330342    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy" containerID="cri-o://ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552" gracePeriod=30
Sep 10 16:00:44.349506 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:44.349432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:44.909354 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:44.909318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:49.571823 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.571796    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 16:00:49.719912 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.719876    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-credential-socket\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.719912 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.719919    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952cc45d-21c7-417b-82b1-b09c671d2698-istiod-ca-cert\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.720178 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.719972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-socket\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.720178 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-certs\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.720178 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720038    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-data\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.720178 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720076    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvl5f\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-kube-api-access-fvl5f\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.720178 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-istio-token\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.720178 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720176    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952cc45d-21c7-417b-82b1-b09c671d2698-istio-podinfo\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.720479 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720217    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-envoy\") pod \"952cc45d-21c7-417b-82b1-b09c671d2698\" (UID: \"952cc45d-21c7-417b-82b1-b09c671d2698\") "
Sep 10 16:00:49.720479 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720208    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:00:49.720479 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720344    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:00:49.720479 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720375    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:00:49.720479 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720405    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-data" (OuterVolumeSpecName: "istio-data") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:00:49.720726 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720556    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/952cc45d-21c7-417b-82b1-b09c671d2698-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:00:49.720726 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720628    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.720726 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720648    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.720726 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720664    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.720726 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.720676    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.722365 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.722337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:00:49.722475 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.722426    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/952cc45d-21c7-417b-82b1-b09c671d2698-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:00:49.722689 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.722665    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-istio-token" (OuterVolumeSpecName: "istio-token") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:00:49.722766 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.722689    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-kube-api-access-fvl5f" (OuterVolumeSpecName: "kube-api-access-fvl5f") pod "952cc45d-21c7-417b-82b1-b09c671d2698" (UID: "952cc45d-21c7-417b-82b1-b09c671d2698"). InnerVolumeSpecName "kube-api-access-fvl5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:00:49.821163 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.821097    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/952cc45d-21c7-417b-82b1-b09c671d2698-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.821163 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.821119    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/952cc45d-21c7-417b-82b1-b09c671d2698-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.821163 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.821131    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvl5f\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-kube-api-access-fvl5f\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.821163 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.821144    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/952cc45d-21c7-417b-82b1-b09c671d2698-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.821163 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.821156    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/952cc45d-21c7-417b-82b1-b09c671d2698-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:00:49.826181 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.826149    2565 generic.go:356] "Generic (PLEG): container finished" podID="952cc45d-21c7-417b-82b1-b09c671d2698" containerID="ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552" exitCode=0
Sep 10 16:00:49.826318 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.826199    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"
Sep 10 16:00:49.826318 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.826234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" event={"ID":"952cc45d-21c7-417b-82b1-b09c671d2698","Type":"ContainerDied","Data":"ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552"}
Sep 10 16:00:49.826318 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.826295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm" event={"ID":"952cc45d-21c7-417b-82b1-b09c671d2698","Type":"ContainerDied","Data":"fe4de72d15f1d5613b5f60c468d77010fef257067cfe5113a827ab2034941ae2"}
Sep 10 16:00:49.826426 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.826327    2565 scope.go:117] "RemoveContainer" containerID="ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552"
Sep 10 16:00:49.836543 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.836524    2565 scope.go:117] "RemoveContainer" containerID="bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e"
Sep 10 16:00:49.845516 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.845497    2565 scope.go:117] "RemoveContainer" containerID="ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552"
Sep 10 16:00:49.845776 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:00:49.845757    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552\": container with ID starting with ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552 not found: ID does not exist" containerID="ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552"
Sep 10 16:00:49.845833 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.845784    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552"} err="failed to get container status \"ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552\": rpc error: code = NotFound desc = could not find container \"ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552\": container with ID starting with ff413a6ba54f30c8271221fff696e554411743647673905cac4b6b52043d0552 not found: ID does not exist"
Sep 10 16:00:49.845833 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.845799    2565 scope.go:117] "RemoveContainer" containerID="bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e"
Sep 10 16:00:49.846045 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:00:49.846024    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e\": container with ID starting with bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e not found: ID does not exist" containerID="bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e"
Sep 10 16:00:49.846112 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.846050    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e"} err="failed to get container status \"bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e\": rpc error: code = NotFound desc = could not find container \"bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e\": container with ID starting with bccdb2f24a2481a46dbe840aea1f8d2c3a13bc7fc7b838267d424d31bff14f9e not found: ID does not exist"
Sep 10 16:00:49.850091 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.850069    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"]
Sep 10 16:00:49.853624 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:49.853599    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f52559-openshift-default-5d96b6bc48-54sxm"]
Sep 10 16:00:51.824242 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:51.824209    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" path="/var/lib/kubelet/pods/952cc45d-21c7-417b-82b1-b09c671d2698/volumes"
Sep 10 16:00:55.222953 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:55.222911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:55.320263 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:55.320222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:55.417237 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:55.417203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:55.475801 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:55.475711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:55.808700 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:55.808597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:00:57.948120 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:00:57.948082    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:01:01.682422 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:01.682387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:01.782446 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:01.782414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:01.928168 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:01.928034    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"]
Sep 10 16:01:01.928348 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:01.928270    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy" containerID="cri-o://41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac" gracePeriod=30
Sep 10 16:01:01.947614 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:01.947542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:02.442195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:02.442161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:07.175470 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.175444    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 16:01:07.265496 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-podinfo\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.265496 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265459    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-credential-socket\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.265496 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265480    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-certs\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.265757 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265556    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-data\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.265757 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-token\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.265757 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265684    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7krm\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-kube-api-access-n7krm\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.265757 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265685    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:07.265757 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265740    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-envoy\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.266057 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265767    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-socket\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.266057 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265792    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istiod-ca-cert\") pod \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\" (UID: \"e10b9c4b-ac37-4737-9d97-60bc11bcc230\") "
Sep 10 16:01:07.266057 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265836    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-data" (OuterVolumeSpecName: "istio-data") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:07.266057 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.265881    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:07.266057 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.266028    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:07.266310 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.266185    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.266310 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.266203    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.266310 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.266205    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:01:07.266310 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.266216    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.266310 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.266230    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.268237 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.268213    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-token" (OuterVolumeSpecName: "istio-token") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:01:07.268337 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.268214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-kube-api-access-n7krm" (OuterVolumeSpecName: "kube-api-access-n7krm") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "kube-api-access-n7krm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:01:07.268337 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.268273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:01:07.268337 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.268278    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e10b9c4b-ac37-4737-9d97-60bc11bcc230" (UID: "e10b9c4b-ac37-4737-9d97-60bc11bcc230"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:07.367391 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.367359    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.367391 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.367385    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.367391 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.367393    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.367586 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.367401    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.367586 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.367410    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7krm\" (UniqueName: \"kubernetes.io/projected/e10b9c4b-ac37-4737-9d97-60bc11bcc230-kube-api-access-n7krm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:07.917888 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.917850    2565 generic.go:356] "Generic (PLEG): container finished" podID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerID="41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac" exitCode=0
Sep 10 16:01:07.918048 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.917895    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"
Sep 10 16:01:07.918048 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.917917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" event={"ID":"e10b9c4b-ac37-4737-9d97-60bc11bcc230","Type":"ContainerDied","Data":"41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac"}
Sep 10 16:01:07.918048 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.917983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm" event={"ID":"e10b9c4b-ac37-4737-9d97-60bc11bcc230","Type":"ContainerDied","Data":"1acdbfdc75ecacafe7e60197887716e7aa6d571a8539a59ea401399bd8130cd7"}
Sep 10 16:01:07.918048 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.918005    2565 scope.go:117] "RemoveContainer" containerID="41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac"
Sep 10 16:01:07.928724 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.928650    2565 scope.go:117] "RemoveContainer" containerID="056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45"
Sep 10 16:01:07.936944 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.936923    2565 scope.go:117] "RemoveContainer" containerID="41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac"
Sep 10 16:01:07.937367 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:01:07.937306    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac\": container with ID starting with 41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac not found: ID does not exist" containerID="41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac"
Sep 10 16:01:07.937502 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.937361    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac"} err="failed to get container status \"41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac\": rpc error: code = NotFound desc = could not find container \"41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac\": container with ID starting with 41c73588224d4879ca4dc2ceb7d6d1a8b00889893d0e649f36c2f076de619fac not found: ID does not exist"
Sep 10 16:01:07.937502 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.937382    2565 scope.go:117] "RemoveContainer" containerID="056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45"
Sep 10 16:01:07.937763 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:01:07.937739    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45\": container with ID starting with 056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45 not found: ID does not exist" containerID="056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45"
Sep 10 16:01:07.937847 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.937784    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45"} err="failed to get container status \"056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45\": rpc error: code = NotFound desc = could not find container \"056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45\": container with ID starting with 056c8fc1219ff5622862a201df2ebed0175f6d7a79d58eaa87c5a0ea5e89bd45 not found: ID does not exist"
Sep 10 16:01:07.939679 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.939662    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"]
Sep 10 16:01:07.945835 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:07.945812    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6f8c71-openshift-default-6ffdd577b6-swjtm"]
Sep 10 16:01:09.824005 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:09.823953    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" path="/var/lib/kubelet/pods/e10b9c4b-ac37-4737-9d97-60bc11bcc230/volumes"
Sep 10 16:01:12.873408 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:12.873372    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"]
Sep 10 16:01:12.876059 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:12.876000    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:12.876380 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:12.876360    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e412c4-29817600-rbjd6"]
Sep 10 16:01:12.977703 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:12.977671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:13.595431 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:13.595400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:13.649145 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:13.649105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:13.825070 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:13.825035    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47bcab38-b27a-4f67-b6f4-c73216149bec" path="/var/lib/kubelet/pods/47bcab38-b27a-4f67-b6f4-c73216149bec/volumes"
Sep 10 16:01:15.545673 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:15.545632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:01:19.368661 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:19.368612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:19.565468 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:19.565432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:19.605250 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:19.605219    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"]
Sep 10 16:01:19.605473 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:19.605443    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy" containerID="cri-o://029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e" gracePeriod=30
Sep 10 16:01:20.424831 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:20.424796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:24.344279 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.344248    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:01:24.853281 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.853256    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 16:01:24.914204 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-credential-socket\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914204 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-certs\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914461 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-podinfo\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914461 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-token\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914461 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914299    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjwzh\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-kube-api-access-jjwzh\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914461 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914334    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-envoy\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914461 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914374    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7fe8f91-e29d-40d8-a087-0211040f014a-istiod-ca-cert\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914461 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-socket\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914461 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-data\") pod \"f7fe8f91-e29d-40d8-a087-0211040f014a\" (UID: \"f7fe8f91-e29d-40d8-a087-0211040f014a\") "
Sep 10 16:01:24.914825 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914494    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:24.914825 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914586    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:24.914825 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914730    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:24.914825 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914798    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7fe8f91-e29d-40d8-a087-0211040f014a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:01:24.914825 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914803    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:24.915129 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.914980    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7fe8f91-e29d-40d8-a087-0211040f014a-istiod-ca-cert\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:24.915129 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.915002    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:24.915129 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.915017    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-credential-socket\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:24.915129 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.915034    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-workload-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:24.916786 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.916753    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:01:24.917010 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.916985    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-kube-api-access-jjwzh" (OuterVolumeSpecName: "kube-api-access-jjwzh") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "kube-api-access-jjwzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:01:24.917097 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.917016    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:01:24.917097 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:24.917024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7fe8f91-e29d-40d8-a087-0211040f014a" (UID: "f7fe8f91-e29d-40d8-a087-0211040f014a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 16:01:25.009424 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.009390    2565 generic.go:356] "Generic (PLEG): container finished" podID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerID="029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e" exitCode=0
Sep 10 16:01:25.009606 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.009442    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"
Sep 10 16:01:25.009606 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.009476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" event={"ID":"f7fe8f91-e29d-40d8-a087-0211040f014a","Type":"ContainerDied","Data":"029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e"}
Sep 10 16:01:25.009606 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.009537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf" event={"ID":"f7fe8f91-e29d-40d8-a087-0211040f014a","Type":"ContainerDied","Data":"9d3717e91dedc27c3add7eb901a0ae6b126067f95905846a945992614f3b36b9"}
Sep 10 16:01:25.009606 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.009567    2565 scope.go:117] "RemoveContainer" containerID="029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e"
Sep 10 16:01:25.015800 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.015772    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-podinfo\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:25.015915 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.015803    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-token\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:25.015915 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.015819    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjwzh\" (UniqueName: \"kubernetes.io/projected/f7fe8f91-e29d-40d8-a087-0211040f014a-kube-api-access-jjwzh\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:25.015915 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.015835    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-envoy\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:25.015915 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.015857    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7fe8f91-e29d-40d8-a087-0211040f014a-istio-data\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:01:25.019393 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.019376    2565 scope.go:117] "RemoveContainer" containerID="826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757"
Sep 10 16:01:25.027058 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.027039    2565 scope.go:117] "RemoveContainer" containerID="029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e"
Sep 10 16:01:25.027323 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:01:25.027304    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e\": container with ID starting with 029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e not found: ID does not exist" containerID="029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e"
Sep 10 16:01:25.027386 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.027331    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e"} err="failed to get container status \"029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e\": rpc error: code = NotFound desc = could not find container \"029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e\": container with ID starting with 029c75e97fa0099b420890a80e0a8f6b43543212a4b9f174f212893183ac6e8e not found: ID does not exist"
Sep 10 16:01:25.027386 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.027347    2565 scope.go:117] "RemoveContainer" containerID="826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757"
Sep 10 16:01:25.027612 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:01:25.027595    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757\": container with ID starting with 826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757 not found: ID does not exist" containerID="826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757"
Sep 10 16:01:25.027650 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.027618    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757"} err="failed to get container status \"826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757\": rpc error: code = NotFound desc = could not find container \"826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757\": container with ID starting with 826ab258cbed7eecd52ac5432a983a6d1d753db99a5879ec7872c483ccfef757 not found: ID does not exist"
Sep 10 16:01:25.031285 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.031264    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"]
Sep 10 16:01:25.035370 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.035348    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e412c4-openshift-default-6b8d6c8c56-9c9lf"]
Sep 10 16:01:25.828172 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:25.825842    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" path="/var/lib/kubelet/pods/f7fe8f91-e29d-40d8-a087-0211040f014a/volumes"
Sep 10 16:01:35.589142 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:35.589110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:01:35.640727 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:01:35.640690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:02:03.789685 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:02:03.789655    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 16:02:03.791462 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:02:03.791442    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 16:02:43.707568 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:02:43.707529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:02:44.641389 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:02:44.641355    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:02:45.813572 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:02:45.813535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:02:47.404128 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:02:47.404093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:02:56.863415 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:02:56.863380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:03:09.749190 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:03:09.749157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:03:16.344196 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:03:16.344155    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:03:23.841195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:03:23.841161    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:03:31.056657 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:03:31.056566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:03:40.346128 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:03:40.346089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:03:47.542146 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:03:47.542107    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:03:54.845255 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:03:54.845216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:04:02.944565 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:04:02.944520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:05:29.547421 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:29.547332    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:05:37.643522 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:37.643484    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:05:43.453027 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:43.452981    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:05:54.237054 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237008    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"]
Sep 10 16:05:54.237538 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237518    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy"
Sep 10 16:05:54.237584 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237541    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy"
Sep 10 16:05:54.237584 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237555    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy"
Sep 10 16:05:54.237584 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237563    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy"
Sep 10 16:05:54.237584 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237576    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy"
Sep 10 16:05:54.237584 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237584    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy"
Sep 10 16:05:54.237749 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237601    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy"
Sep 10 16:05:54.237749 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237610    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy"
Sep 10 16:05:54.237749 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237625    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy"
Sep 10 16:05:54.237749 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237633    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy"
Sep 10 16:05:54.237749 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237646    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fab1958-c1bd-47d2-b31b-270c008a192e" containerName="revoke-keys"
Sep 10 16:05:54.237749 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237655    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fab1958-c1bd-47d2-b31b-270c008a192e" containerName="revoke-keys"
Sep 10 16:05:54.237941 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237759    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy"
Sep 10 16:05:54.237941 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237771    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy"
Sep 10 16:05:54.237941 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237778    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy"
Sep 10 16:05:54.237941 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237787    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy"
Sep 10 16:05:54.237941 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237796    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7fe8f91-e29d-40d8-a087-0211040f014a" containerName="istio-proxy"
Sep 10 16:05:54.237941 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237804    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fab1958-c1bd-47d2-b31b-270c008a192e" containerName="revoke-keys"
Sep 10 16:05:54.237941 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.237810    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="952cc45d-21c7-417b-82b1-b09c671d2698" containerName="istio-proxy"
Sep 10 16:05:54.240665 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.240651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.243123 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.243101    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-470bc450-kserve-self-signed-certs\""
Sep 10 16:05:54.252989 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.252948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"]
Sep 10 16:05:54.295222 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.295200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:05:54.377219 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.377191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-model-cache\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.377411 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.377226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ttjk\" (UniqueName: \"kubernetes.io/projected/79e4d01f-c7b7-4d78-b254-aeece02eb47f-kube-api-access-2ttjk\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.377411 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.377259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tls-certs\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.377411 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.377345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-home\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.377560 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.377419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-dshm\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.377560 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.377451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tmp-dir\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478008 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.477946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tls-certs\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478182 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.478043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-home\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478182 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.478105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-dshm\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478182 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.478132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tmp-dir\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478347 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.478181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-model-cache\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478347 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.478207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ttjk\" (UniqueName: \"kubernetes.io/projected/79e4d01f-c7b7-4d78-b254-aeece02eb47f-kube-api-access-2ttjk\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478538 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.478508    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-home\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478672 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.478577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tmp-dir\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.478672 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.478590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-model-cache\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.480418 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.480388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-dshm\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.480657 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.480641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tls-certs\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.486194 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.486169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ttjk\" (UniqueName: \"kubernetes.io/projected/79e4d01f-c7b7-4d78-b254-aeece02eb47f-kube-api-access-2ttjk\") pod \"e2e-same-id-a-470bc450-kserve-659db79b55-59p7d\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") " pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.549429 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.549353    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:05:54.818349 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:54.818322    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"]
Sep 10 16:05:54.820800 ip-10-0-136-122 kubenswrapper[2565]: W0910 16:05:54.820772    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79e4d01f_c7b7_4d78_b254_aeece02eb47f.slice/crio-c5404deefa1ec587a6520126b4e5a59080ceb78492365d22c77f5def78904c59 WatchSource:0}: Error finding container c5404deefa1ec587a6520126b4e5a59080ceb78492365d22c77f5def78904c59: Status 404 returned error can't find the container with id c5404deefa1ec587a6520126b4e5a59080ceb78492365d22c77f5def78904c59
Sep 10 16:05:55.318565 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:55.318526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d" event={"ID":"79e4d01f-c7b7-4d78-b254-aeece02eb47f","Type":"ContainerStarted","Data":"49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3"}
Sep 10 16:05:55.318565 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:55.318575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d" event={"ID":"79e4d01f-c7b7-4d78-b254-aeece02eb47f","Type":"ContainerStarted","Data":"c5404deefa1ec587a6520126b4e5a59080ceb78492365d22c77f5def78904c59"}
Sep 10 16:05:55.335134 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:55.335083    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d" podStartSLOduration=1.3350691430000001 podStartE2EDuration="1.335069143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:05:55.333446323 +0000 UTC m=+2032.148522063" watchObservedRunningTime="2026-09-10 16:05:55.335069143 +0000 UTC m=+2032.150144883"
Sep 10 16:05:56.749400 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:05:56.749363    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:06:00.248568 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.248527    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"]
Sep 10 16:06:00.249119 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.249088    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy"
Sep 10 16:06:00.249119 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.249107    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10b9c4b-ac37-4737-9d97-60bc11bcc230" containerName="istio-proxy"
Sep 10 16:06:00.252973 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.252936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.255329 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.255307    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-470bc450-kserve-self-signed-certs\""
Sep 10 16:06:00.262513 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.262487    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"]
Sep 10 16:06:00.275154 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.275127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:06:00.429526 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.429488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-model-cache\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.429526 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.429530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tls-certs\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.429787 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.429569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-dshm\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.429787 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.429626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whbvf\" (UniqueName: \"kubernetes.io/projected/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-kube-api-access-whbvf\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.429787 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.429684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tmp-dir\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.429787 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.429721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-home\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530380 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whbvf\" (UniqueName: \"kubernetes.io/projected/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-kube-api-access-whbvf\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530380 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tmp-dir\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530380 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-home\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530685 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-model-cache\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530685 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tls-certs\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530685 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-dshm\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530857 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tmp-dir\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530857 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-model-cache\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.530938 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.530871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-home\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.532772 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.532741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-dshm\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.532939 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.532920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tls-certs\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.538006 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.537985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whbvf\" (UniqueName: \"kubernetes.io/projected/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-kube-api-access-whbvf\") pod \"e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") " pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.564171 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.564148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:00.831228 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:00.831151    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"]
Sep 10 16:06:00.834457 ip-10-0-136-122 kubenswrapper[2565]: W0910 16:06:00.834430    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7ef0c20_1e0e_4c0e_a29e_c7e7be0b536c.slice/crio-604cd131028577c60fb596a785b125cc49ef588c0f33e9a35bb63784085ad2b8 WatchSource:0}: Error finding container 604cd131028577c60fb596a785b125cc49ef588c0f33e9a35bb63784085ad2b8: Status 404 returned error can't find the container with id 604cd131028577c60fb596a785b125cc49ef588c0f33e9a35bb63784085ad2b8
Sep 10 16:06:01.349645 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:01.349608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p" event={"ID":"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c","Type":"ContainerStarted","Data":"7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46"}
Sep 10 16:06:01.349645 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:01.349648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p" event={"ID":"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c","Type":"ContainerStarted","Data":"604cd131028577c60fb596a785b125cc49ef588c0f33e9a35bb63784085ad2b8"}
Sep 10 16:06:01.366130 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:01.366076    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p" podStartSLOduration=1.366059729 podStartE2EDuration="1.366059729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:06:01.364855052 +0000 UTC m=+2038.179930794" watchObservedRunningTime="2026-09-10 16:06:01.366059729 +0000 UTC m=+2038.181135463"
Sep 10 16:06:04.097041 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:04.097007    2565 scope.go:117] "RemoveContainer" containerID="5ea1b6f1a0424227aaa1c7cdaffc6a4a132b6795e03ef73bdecd90406b5e25da"
Sep 10 16:06:04.348211 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:04.348125    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:06:04.550444 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:04.550398    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:06:04.550620 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:04.550462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:06:04.563689 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:04.563645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:06:05.382085 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:05.382055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:06:10.565089 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:10.565049    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:10.565567 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:10.565345    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:10.577900 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:10.577869    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:11.411121 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:11.411092    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:41.095369 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:41.095281    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"]
Sep 10 16:06:41.500747 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:41.500699    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:06:42.875479 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:42.875445    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"]
Sep 10 16:06:42.895875 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:42.895847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:06:43.347380 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:43.347347    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:06:49.751757 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:49.751724    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:06:55.938843 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:55.938807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:06:56.115584 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.115545    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d" podUID="79e4d01f-c7b7-4d78-b254-aeece02eb47f" containerName="main" containerID="cri-o://49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3" gracePeriod=45
Sep 10 16:06:56.353372 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.353348    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:06:56.425297 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425270    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ttjk\" (UniqueName: \"kubernetes.io/projected/79e4d01f-c7b7-4d78-b254-aeece02eb47f-kube-api-access-2ttjk\") pod \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") "
Sep 10 16:06:56.425449 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tmp-dir\") pod \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") "
Sep 10 16:06:56.425449 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425355    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tls-certs\") pod \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") "
Sep 10 16:06:56.425449 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-home\") pod \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") "
Sep 10 16:06:56.425449 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425411    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-dshm\") pod \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") "
Sep 10 16:06:56.425449 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-model-cache\") pod \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\" (UID: \"79e4d01f-c7b7-4d78-b254-aeece02eb47f\") "
Sep 10 16:06:56.425775 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425665    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "79e4d01f-c7b7-4d78-b254-aeece02eb47f" (UID: "79e4d01f-c7b7-4d78-b254-aeece02eb47f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:06:56.425775 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-home" (OuterVolumeSpecName: "home") pod "79e4d01f-c7b7-4d78-b254-aeece02eb47f" (UID: "79e4d01f-c7b7-4d78-b254-aeece02eb47f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:06:56.425849 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.425768    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-model-cache" (OuterVolumeSpecName: "model-cache") pod "79e4d01f-c7b7-4d78-b254-aeece02eb47f" (UID: "79e4d01f-c7b7-4d78-b254-aeece02eb47f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:06:56.427463 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.427437    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-dshm" (OuterVolumeSpecName: "dshm") pod "79e4d01f-c7b7-4d78-b254-aeece02eb47f" (UID: "79e4d01f-c7b7-4d78-b254-aeece02eb47f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:06:56.427566 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.427463    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79e4d01f-c7b7-4d78-b254-aeece02eb47f-kube-api-access-2ttjk" (OuterVolumeSpecName: "kube-api-access-2ttjk") pod "79e4d01f-c7b7-4d78-b254-aeece02eb47f" (UID: "79e4d01f-c7b7-4d78-b254-aeece02eb47f"). InnerVolumeSpecName "kube-api-access-2ttjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:06:56.427566 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.427536    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "79e4d01f-c7b7-4d78-b254-aeece02eb47f" (UID: "79e4d01f-c7b7-4d78-b254-aeece02eb47f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:06:56.527195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.527113    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:56.527195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.527143    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:56.527195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.527151    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:56.527195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.527159    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:56.527195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.527168    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ttjk\" (UniqueName: \"kubernetes.io/projected/79e4d01f-c7b7-4d78-b254-aeece02eb47f-kube-api-access-2ttjk\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:56.527195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.527178    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79e4d01f-c7b7-4d78-b254-aeece02eb47f-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:56.627755 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.627715    2565 generic.go:356] "Generic (PLEG): container finished" podID="79e4d01f-c7b7-4d78-b254-aeece02eb47f" containerID="49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3" exitCode=0
Sep 10 16:06:56.627755 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.627759    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"
Sep 10 16:06:56.628010 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.627802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d" event={"ID":"79e4d01f-c7b7-4d78-b254-aeece02eb47f","Type":"ContainerDied","Data":"49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3"}
Sep 10 16:06:56.628010 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.627847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d" event={"ID":"79e4d01f-c7b7-4d78-b254-aeece02eb47f","Type":"ContainerDied","Data":"c5404deefa1ec587a6520126b4e5a59080ceb78492365d22c77f5def78904c59"}
Sep 10 16:06:56.628010 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.627863    2565 scope.go:117] "RemoveContainer" containerID="49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3"
Sep 10 16:06:56.637268 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.637251    2565 scope.go:117] "RemoveContainer" containerID="49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3"
Sep 10 16:06:56.637514 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:06:56.637492    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3\": container with ID starting with 49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3 not found: ID does not exist" containerID="49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3"
Sep 10 16:06:56.637573 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.637526    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3"} err="failed to get container status \"49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3\": rpc error: code = NotFound desc = could not find container \"49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3\": container with ID starting with 49859e5152291ad0429eded8f2f62793f08d5b86e1ffa790033e1c6752f8f6d3 not found: ID does not exist"
Sep 10 16:06:56.648138 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.648113    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"]
Sep 10 16:06:56.651493 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:56.651474    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-470bc450-kserve-659db79b55-59p7d"]
Sep 10 16:06:57.823856 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:57.823824    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79e4d01f-c7b7-4d78-b254-aeece02eb47f" path="/var/lib/kubelet/pods/79e4d01f-c7b7-4d78-b254-aeece02eb47f/volumes"
Sep 10 16:06:57.895558 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:57.895519    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p" podUID="c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" containerName="main" containerID="cri-o://7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46" gracePeriod=45
Sep 10 16:06:58.137715 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.137691    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:58.242919 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.242886    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-model-cache\") pod \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") "
Sep 10 16:06:58.243097 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.242944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whbvf\" (UniqueName: \"kubernetes.io/projected/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-kube-api-access-whbvf\") pod \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") "
Sep 10 16:06:58.243097 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.243001    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-home\") pod \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") "
Sep 10 16:06:58.243097 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.243056    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tls-certs\") pod \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") "
Sep 10 16:06:58.243097 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.243070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-dshm\") pod \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") "
Sep 10 16:06:58.243097 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.243096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tmp-dir\") pod \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\" (UID: \"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c\") "
Sep 10 16:06:58.243358 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.243130    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-model-cache" (OuterVolumeSpecName: "model-cache") pod "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" (UID: "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:06:58.243358 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.243269    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-model-cache\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:58.243358 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.243310    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-home" (OuterVolumeSpecName: "home") pod "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" (UID: "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:06:58.243499 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.243356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" (UID: "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:06:58.245210 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.245188    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" (UID: "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:06:58.245323 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.245192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-dshm" (OuterVolumeSpecName: "dshm") pod "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" (UID: "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 16:06:58.245323 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.245235    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-kube-api-access-whbvf" (OuterVolumeSpecName: "kube-api-access-whbvf") pod "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" (UID: "c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c"). InnerVolumeSpecName "kube-api-access-whbvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:06:58.344246 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.344211    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-home\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:58.344246 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.344241    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tls-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:58.344246 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.344251    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-dshm\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:58.344485 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.344258    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-tmp-dir\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:58.344485 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.344268    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whbvf\" (UniqueName: \"kubernetes.io/projected/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c-kube-api-access-whbvf\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:06:58.640226 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.640189    2565 generic.go:356] "Generic (PLEG): container finished" podID="c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" containerID="7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46" exitCode=0
Sep 10 16:06:58.640415 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.640243    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"
Sep 10 16:06:58.640415 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.640275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p" event={"ID":"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c","Type":"ContainerDied","Data":"7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46"}
Sep 10 16:06:58.640415 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.640313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p" event={"ID":"c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c","Type":"ContainerDied","Data":"604cd131028577c60fb596a785b125cc49ef588c0f33e9a35bb63784085ad2b8"}
Sep 10 16:06:58.640415 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.640333    2565 scope.go:117] "RemoveContainer" containerID="7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46"
Sep 10 16:06:58.655483 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.649736    2565 scope.go:117] "RemoveContainer" containerID="7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46"
Sep 10 16:06:58.655483 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:06:58.650096    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46\": container with ID starting with 7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46 not found: ID does not exist" containerID="7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46"
Sep 10 16:06:58.655483 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.650133    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46"} err="failed to get container status \"7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46\": rpc error: code = NotFound desc = could not find container \"7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46\": container with ID starting with 7ffddf80bfce0363abf2c81cf3d04b0d0e864e82bf98504683195b5ba0d07e46 not found: ID does not exist"
Sep 10 16:06:58.667744 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.667719    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"]
Sep 10 16:06:58.671535 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:58.671512    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-470bc450-kserve-5bbcd68975-q7c8p"]
Sep 10 16:06:59.824518 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:06:59.824479    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" path="/var/lib/kubelet/pods/c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c/volumes"
Sep 10 16:07:01.270093 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.270052    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-699674684b-7sfzp"]
Sep 10 16:07:01.270482 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.270410    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79e4d01f-c7b7-4d78-b254-aeece02eb47f" containerName="main"
Sep 10 16:07:01.270482 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.270421    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="79e4d01f-c7b7-4d78-b254-aeece02eb47f" containerName="main"
Sep 10 16:07:01.270482 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.270445    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" containerName="main"
Sep 10 16:07:01.270482 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.270451    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" containerName="main"
Sep 10 16:07:01.270615 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.270506    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="79e4d01f-c7b7-4d78-b254-aeece02eb47f" containerName="main"
Sep 10 16:07:01.270615 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.270518    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ef0c20-1e0e-4c0e-a29e-c7e7be0b536c" containerName="main"
Sep 10 16:07:01.275009 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.274986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.278466 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.278442    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 16:07:01.278596 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.278474    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ql4pw\""
Sep 10 16:07:01.278596 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.278446    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 16:07:01.278596 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.278573    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 16:07:01.278723 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.278670    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 16:07:01.283423 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.283400    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-699674684b-7sfzp"]
Sep 10 16:07:01.370207 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.370175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-maas-api-tls\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.370207 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.370208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-metrics-certs\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.370421 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.370227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2hkx\" (UniqueName: \"kubernetes.io/projected/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-kube-api-access-p2hkx\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.370421 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.370318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-openshift-service-ca\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.471321 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.471285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-openshift-service-ca\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.471482 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.471377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-maas-api-tls\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.471482 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.471396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-metrics-certs\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.471482 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.471410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2hkx\" (UniqueName: \"kubernetes.io/projected/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-kube-api-access-p2hkx\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.471922 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.471900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-openshift-service-ca\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.473784 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.473755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-metrics-certs\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.473887 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.473784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-maas-api-tls\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.478859 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.478835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2hkx\" (UniqueName: \"kubernetes.io/projected/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-kube-api-access-p2hkx\") pod \"maas-api-699674684b-7sfzp\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") " pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.587457 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.587367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:01.860329 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.860252    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-699674684b-7sfzp"]
Sep 10 16:07:01.862727 ip-10-0-136-122 kubenswrapper[2565]: W0910 16:07:01.862702    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b7a5aa_b0e9_49ee_b904_dc683ebd7fb6.slice/crio-5a09780ec3ccd97557e2b5ad3c52ea6cb0f466669a70532142c56a1a4a823eff WatchSource:0}: Error finding container 5a09780ec3ccd97557e2b5ad3c52ea6cb0f466669a70532142c56a1a4a823eff: Status 404 returned error can't find the container with id 5a09780ec3ccd97557e2b5ad3c52ea6cb0f466669a70532142c56a1a4a823eff
Sep 10 16:07:01.864379 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:01.864361    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 16:07:02.049485 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:02.049448    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:07:02.664142 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:02.664107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp" event={"ID":"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6","Type":"ContainerStarted","Data":"8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e"}
Sep 10 16:07:02.664456 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:02.664159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp" event={"ID":"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6","Type":"ContainerStarted","Data":"5a09780ec3ccd97557e2b5ad3c52ea6cb0f466669a70532142c56a1a4a823eff"}
Sep 10 16:07:02.664456 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:02.664217    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:02.682336 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:02.682287    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp" podStartSLOduration=0.9539306 podStartE2EDuration="1.682270876s" totalImagesPullingTime="728.340276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:07:02.680652928 +0000 UTC m=+2099.495728698" watchObservedRunningTime="2026-09-10 16:07:02.682270876 +0000 UTC m=+2099.497346615"
Sep 10 16:07:03.820354 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:03.820323    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 16:07:03.823573 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:03.823550    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sm2lv_04372fc7-12a8-459b-830f-3ce77f3fe2f0/ovn-acl-logging/0.log"
Sep 10 16:07:04.118305 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:04.118230    2565 scope.go:117] "RemoveContainer" containerID="939eabb5ceaccf08c1b3d21bb27f45c600e77a6a203e4a003386f6128d36bd1e"
Sep 10 16:07:08.674800 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:08.674769    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:08.945737 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:08.945654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:07:09.157652 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.157616    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"]
Sep 10 16:07:09.161314 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.161290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.170198 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.170173    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"]
Sep 10 16:07:09.240494 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.240427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d14fe02-6dda-4888-9297-caff3ed5bc1f-metrics-certs\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.240494 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.240482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d14fe02-6dda-4888-9297-caff3ed5bc1f-openshift-service-ca\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.240639 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.240538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmsqz\" (UniqueName: \"kubernetes.io/projected/5d14fe02-6dda-4888-9297-caff3ed5bc1f-kube-api-access-fmsqz\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.240639 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.240601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d14fe02-6dda-4888-9297-caff3ed5bc1f-maas-api-tls\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.341120 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.341090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d14fe02-6dda-4888-9297-caff3ed5bc1f-maas-api-tls\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.341283 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.341150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d14fe02-6dda-4888-9297-caff3ed5bc1f-metrics-certs\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.341283 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.341192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d14fe02-6dda-4888-9297-caff3ed5bc1f-openshift-service-ca\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.341283 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.341230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmsqz\" (UniqueName: \"kubernetes.io/projected/5d14fe02-6dda-4888-9297-caff3ed5bc1f-kube-api-access-fmsqz\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.341906 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.341883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d14fe02-6dda-4888-9297-caff3ed5bc1f-openshift-service-ca\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.343632 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.343609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d14fe02-6dda-4888-9297-caff3ed5bc1f-metrics-certs\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.343733 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.343649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d14fe02-6dda-4888-9297-caff3ed5bc1f-maas-api-tls\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.349581 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.349553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmsqz\" (UniqueName: \"kubernetes.io/projected/5d14fe02-6dda-4888-9297-caff3ed5bc1f-kube-api-access-fmsqz\") pod \"maas-api-bcbc8bfdb-d7jnk\" (UID: \"5d14fe02-6dda-4888-9297-caff3ed5bc1f\") " pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.473245 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.473214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:09.742366 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:09.742340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"]
Sep 10 16:07:09.744735 ip-10-0-136-122 kubenswrapper[2565]: W0910 16:07:09.744708    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d14fe02_6dda_4888_9297_caff3ed5bc1f.slice/crio-6647424c26c8e0948e3555df6c97a879903bb9fc9efb3955cf876a4f05030a08 WatchSource:0}: Error finding container 6647424c26c8e0948e3555df6c97a879903bb9fc9efb3955cf876a4f05030a08: Status 404 returned error can't find the container with id 6647424c26c8e0948e3555df6c97a879903bb9fc9efb3955cf876a4f05030a08
Sep 10 16:07:10.705222 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:10.705183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk" event={"ID":"5d14fe02-6dda-4888-9297-caff3ed5bc1f","Type":"ContainerStarted","Data":"8af6495c5fda14241dcb77920979d22e3d3136e56ea20647657cf7dcd01cc6f6"}
Sep 10 16:07:10.705421 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:10.705236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk" event={"ID":"5d14fe02-6dda-4888-9297-caff3ed5bc1f","Type":"ContainerStarted","Data":"6647424c26c8e0948e3555df6c97a879903bb9fc9efb3955cf876a4f05030a08"}
Sep 10 16:07:10.705421 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:10.705292    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:10.722815 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:10.722775    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk" podStartSLOduration=1.300417039 podStartE2EDuration="1.722760086s" totalImagesPullingTime="422.343047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:07:10.720686312 +0000 UTC m=+2107.535762053" watchObservedRunningTime="2026-09-10 16:07:10.722760086 +0000 UTC m=+2107.537835825"
Sep 10 16:07:15.946891 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:15.946855    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:07:16.718032 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:16.718004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-bcbc8bfdb-d7jnk"
Sep 10 16:07:16.763848 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:16.763781    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-699674684b-7sfzp"]
Sep 10 16:07:16.764094 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:16.764044    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp" podUID="48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" containerName="maas-api" containerID="cri-o://8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e" gracePeriod=30
Sep 10 16:07:17.002841 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.002817    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:17.115071 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.115040    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-maas-api-tls\") pod \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") "
Sep 10 16:07:17.115071 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.115075    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-metrics-certs\") pod \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") "
Sep 10 16:07:17.115268 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.115165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2hkx\" (UniqueName: \"kubernetes.io/projected/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-kube-api-access-p2hkx\") pod \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") "
Sep 10 16:07:17.115268 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.115193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-openshift-service-ca\") pod \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\" (UID: \"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6\") "
Sep 10 16:07:17.115589 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.115557    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" (UID: "48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 16:07:17.117296 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.117268    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" (UID: "48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:07:17.117378 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.117287    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-kube-api-access-p2hkx" (OuterVolumeSpecName: "kube-api-access-p2hkx") pod "48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" (UID: "48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6"). InnerVolumeSpecName "kube-api-access-p2hkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 16:07:17.117378 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.117279    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" (UID: "48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 16:07:17.216261 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.216234    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2hkx\" (UniqueName: \"kubernetes.io/projected/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-kube-api-access-p2hkx\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:07:17.216261 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.216257    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-openshift-service-ca\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:07:17.216413 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.216266    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-maas-api-tls\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:07:17.216413 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.216279    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6-metrics-certs\") on node \"ip-10-0-136-122.ec2.internal\" DevicePath \"\""
Sep 10 16:07:17.743219 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.743183    2565 generic.go:356] "Generic (PLEG): container finished" podID="48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" containerID="8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e" exitCode=0
Sep 10 16:07:17.743407 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.743224    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp"
Sep 10 16:07:17.743407 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.743263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp" event={"ID":"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6","Type":"ContainerDied","Data":"8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e"}
Sep 10 16:07:17.743407 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.743312    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699674684b-7sfzp" event={"ID":"48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6","Type":"ContainerDied","Data":"5a09780ec3ccd97557e2b5ad3c52ea6cb0f466669a70532142c56a1a4a823eff"}
Sep 10 16:07:17.743407 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.743338    2565 scope.go:117] "RemoveContainer" containerID="8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e"
Sep 10 16:07:17.752528 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.752512    2565 scope.go:117] "RemoveContainer" containerID="8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e"
Sep 10 16:07:17.752777 ip-10-0-136-122 kubenswrapper[2565]: E0910 16:07:17.752759    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e\": container with ID starting with 8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e not found: ID does not exist" containerID="8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e"
Sep 10 16:07:17.752842 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.752784    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e"} err="failed to get container status \"8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e\": rpc error: code = NotFound desc = could not find container \"8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e\": container with ID starting with 8825569b5beb53a0cf022129cad53952dcba2972c198fd201634a451db60887e not found: ID does not exist"
Sep 10 16:07:17.763233 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.763211    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-699674684b-7sfzp"]
Sep 10 16:07:17.766441 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.766420    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-699674684b-7sfzp"]
Sep 10 16:07:17.823643 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:17.823618    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" path="/var/lib/kubelet/pods/48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6/volumes"
Sep 10 16:07:20.845400 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:20.845362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:07:23.250629 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:23.250589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:07:28.085593 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:28.085549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8xwwp"]
Sep 10 16:07:33.466445 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:33.466409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:07:33.517752 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:33.517708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:07:37.592918 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:37.592888    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f4cd445f-8xwcd_03a67e64-4565-4af7-bfe9-acfe7fe6d5b4/copy-manifests/0.log"
Sep 10 16:07:37.599186 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:37.599152    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f4cd445f-8xwcd_03a67e64-4565-4af7-bfe9-acfe7fe6d5b4/manager/0.log"
Sep 10 16:07:38.211023 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:38.210988    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-bcbc8bfdb-d7jnk_5d14fe02-6dda-4888-9297-caff3ed5bc1f/maas-api/0.log"
Sep 10 16:07:38.559126 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:38.559051    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817600-kh64q_d9f62147-7227-45a1-8449-c181822e66e1/cleanup/0.log"
Sep 10 16:07:39.852934 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:39.852904    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-shwbv_30220f6d-2e4f-478c-8cde-23797c266d51/kuadrant-console-plugin/0.log"
Sep 10 16:07:40.105405 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:40.105331    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-8xwwp_167d372c-3594-40ca-b622-11cccf2acbfb/limitador/0.log"
Sep 10 16:07:40.945572 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:40.945478    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5b58d48c-sjl65_7d5966a0-9a10-4dca-b54a-30f8a8804822/kube-auth-proxy/0.log"
Sep 10 16:07:41.435783 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:41.435756    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8646695894-4pgll_6ee431f4-2197-4401-94bb-3810063e3595/router/0.log"
Sep 10 16:07:42.276672 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:42.276640    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6m5h9_57092d88-2640-4e1c-baea-63abd28699ab/main/0.log"
Sep 10 16:07:42.510599 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:42.510572    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-l6qgr_26537ff6-4cf4-4a0f-bfdf-ad3104d2b89a/main/0.log"
Sep 10 16:07:48.251243 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:48.251203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:07:48.441120 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:48.441085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:07:51.310284 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:51.310255    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4qndm_cb44b5c1-8d56-4e63-80da-38fa93d65001/global-pull-secret-syncer/0.log"
Sep 10 16:07:51.437275 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:51.437244    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log"
Sep 10 16:07:51.551474 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:51.551448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-122.ec2.internal_0b09277e132d6aefa278e6b0df456da0/haproxy/0.log"
Sep 10 16:07:56.380028 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:56.379994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-shwbv_30220f6d-2e4f-478c-8cde-23797c266d51/kuadrant-console-plugin/0.log"
Sep 10 16:07:56.443008 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:56.442978    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-8xwwp_167d372c-3594-40ca-b622-11cccf2acbfb/limitador/0.log"
Sep 10 16:07:57.941894 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:57.941860    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bff19772-cf19-4ceb-9e33-6927227af513/alertmanager/0.log"
Sep 10 16:07:57.962875 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:57.962853    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bff19772-cf19-4ceb-9e33-6927227af513/config-reloader/0.log"
Sep 10 16:07:57.986010 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:57.985993    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bff19772-cf19-4ceb-9e33-6927227af513/kube-rbac-proxy-web/0.log"
Sep 10 16:07:58.008392 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.008365    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bff19772-cf19-4ceb-9e33-6927227af513/kube-rbac-proxy/0.log"
Sep 10 16:07:58.034954 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.034931    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bff19772-cf19-4ceb-9e33-6927227af513/kube-rbac-proxy-metric/0.log"
Sep 10 16:07:58.063350 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.063332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bff19772-cf19-4ceb-9e33-6927227af513/prom-label-proxy/0.log"
Sep 10 16:07:58.084896 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.084879    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bff19772-cf19-4ceb-9e33-6927227af513/init-config-reloader/0.log"
Sep 10 16:07:58.129242 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.129222    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-8t5kw_86cdaaa5-74fd-4e44-aa6f-39bdbc5f1fc8/cluster-monitoring-operator/0.log"
Sep 10 16:07:58.158439 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.158417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-dqq75_fd09721a-8841-42aa-b4c2-045c9c476845/kube-state-metrics/0.log"
Sep 10 16:07:58.190379 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.190358    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-dqq75_fd09721a-8841-42aa-b4c2-045c9c476845/kube-rbac-proxy-main/0.log"
Sep 10 16:07:58.215280 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.215226    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-dqq75_fd09721a-8841-42aa-b4c2-045c9c476845/kube-rbac-proxy-self/0.log"
Sep 10 16:07:58.242685 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.242662    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54fcb87db5-xcnpg_b93561f7-963b-4266-9e6f-0acbd0250f0f/metrics-server/0.log"
Sep 10 16:07:58.300512 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.300488    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-65x55_c8971910-ae93-4da1-943f-48b6cd961b27/node-exporter/0.log"
Sep 10 16:07:58.321890 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.321866    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-65x55_c8971910-ae93-4da1-943f-48b6cd961b27/kube-rbac-proxy/0.log"
Sep 10 16:07:58.342023 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.342003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-65x55_c8971910-ae93-4da1-943f-48b6cd961b27/init-textfile/0.log"
Sep 10 16:07:58.581262 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.581192    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-zv6wp_81466602-fd20-47d7-a1a7-1eb9b20fb127/kube-rbac-proxy-main/0.log"
Sep 10 16:07:58.606238 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.606216    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-zv6wp_81466602-fd20-47d7-a1a7-1eb9b20fb127/kube-rbac-proxy-self/0.log"
Sep 10 16:07:58.628498 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.628476    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-zv6wp_81466602-fd20-47d7-a1a7-1eb9b20fb127/openshift-state-metrics/0.log"
Sep 10 16:07:58.883688 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:58.883609    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-pmvkz_53231d4f-c522-4794-a1d3-bbd7f36f77c2/prometheus-operator-admission-webhook/0.log"
Sep 10 16:07:59.007097 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:59.007071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495578cc-zzk6h_090b63fa-ba58-40af-b3d0-596d98349b0e/thanos-query/0.log"
Sep 10 16:07:59.029019 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:59.028994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495578cc-zzk6h_090b63fa-ba58-40af-b3d0-596d98349b0e/kube-rbac-proxy-web/0.log"
Sep 10 16:07:59.050571 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:59.050546    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495578cc-zzk6h_090b63fa-ba58-40af-b3d0-596d98349b0e/kube-rbac-proxy/0.log"
Sep 10 16:07:59.071418 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:59.071396    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495578cc-zzk6h_090b63fa-ba58-40af-b3d0-596d98349b0e/prom-label-proxy/0.log"
Sep 10 16:07:59.092352 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:59.092335    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495578cc-zzk6h_090b63fa-ba58-40af-b3d0-596d98349b0e/kube-rbac-proxy-rules/0.log"
Sep 10 16:07:59.114118 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:07:59.114100    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495578cc-zzk6h_090b63fa-ba58-40af-b3d0-596d98349b0e/kube-rbac-proxy-metrics/0.log"
Sep 10 16:08:01.346130 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.346096    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"]
Sep 10 16:08:01.346496 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.346445    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" containerName="maas-api"
Sep 10 16:08:01.346496 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.346456    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" containerName="maas-api"
Sep 10 16:08:01.346575 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.346533    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b7a5aa-b0e9-49ee-b904-dc683ebd7fb6" containerName="maas-api"
Sep 10 16:08:01.350001 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.349981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.352329 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.352307    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ccz5g\"/\"kube-root-ca.crt\""
Sep 10 16:08:01.352416 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.352338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ccz5g\"/\"openshift-service-ca.crt\""
Sep 10 16:08:01.353128 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.353113    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ccz5g\"/\"default-dockercfg-5k4tw\""
Sep 10 16:08:01.359011 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.358985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"]
Sep 10 16:08:01.402739 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.402715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gwqg\" (UniqueName: \"kubernetes.io/projected/4c836099-cb98-4320-827a-bc3e49951fc7-kube-api-access-9gwqg\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.402852 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.402749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-lib-modules\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.402852 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.402815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-proc\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.402852 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.402839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-podres\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.403026 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.402904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-sys\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504032 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-sys\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504145 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gwqg\" (UniqueName: \"kubernetes.io/projected/4c836099-cb98-4320-827a-bc3e49951fc7-kube-api-access-9gwqg\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504145 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-sys\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504444 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-lib-modules\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504444 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-proc\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504444 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-podres\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504444 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-proc\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504444 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-podres\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.504444 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.504367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c836099-cb98-4320-827a-bc3e49951fc7-lib-modules\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.511620 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.511593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gwqg\" (UniqueName: \"kubernetes.io/projected/4c836099-cb98-4320-827a-bc3e49951fc7-kube-api-access-9gwqg\") pod \"perf-node-gather-daemonset-v24z6\" (UID: \"4c836099-cb98-4320-827a-bc3e49951fc7\") " pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.660554 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.660529    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:01.928747 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.928703    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"]
Sep 10 16:08:01.931104 ip-10-0-136-122 kubenswrapper[2565]: W0910 16:08:01.931072    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4c836099_cb98_4320_827a_bc3e49951fc7.slice/crio-32763edeedaafbadceb6a21ed114256b94bdf7eda8c865fb010094df0151bc41 WatchSource:0}: Error finding container 32763edeedaafbadceb6a21ed114256b94bdf7eda8c865fb010094df0151bc41: Status 404 returned error can't find the container with id 32763edeedaafbadceb6a21ed114256b94bdf7eda8c865fb010094df0151bc41
Sep 10 16:08:01.965021 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:01.964986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6" event={"ID":"4c836099-cb98-4320-827a-bc3e49951fc7","Type":"ContainerStarted","Data":"32763edeedaafbadceb6a21ed114256b94bdf7eda8c865fb010094df0151bc41"}
Sep 10 16:08:02.972600 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:02.972562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6" event={"ID":"4c836099-cb98-4320-827a-bc3e49951fc7","Type":"ContainerStarted","Data":"927dd777ecd0ae4f56d3cb0288641d96727106f6203f6f081e65c289d3f75b58"}
Sep 10 16:08:02.973003 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:02.972641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:02.988937 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:02.988893    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6" podStartSLOduration=1.9888804580000001 podStartE2EDuration="1.988880458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:02.987182224 +0000 UTC m=+2159.802257978" watchObservedRunningTime="2026-09-10 16:08:02.988880458 +0000 UTC m=+2159.803956229"
Sep 10 16:08:03.540770 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:03.540741    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8pvt4_a2bdf391-fbbf-4277-a0df-48771809d7f2/dns/0.log"
Sep 10 16:08:03.565479 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:03.565458    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8pvt4_a2bdf391-fbbf-4277-a0df-48771809d7f2/kube-rbac-proxy/0.log"
Sep 10 16:08:03.689854 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:03.689827    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8rbvn_8e98af8d-2a41-4fc6-9e7e-9d5280aa0a20/dns-node-resolver/0.log"
Sep 10 16:08:04.333764 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:04.333735    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s2ccc_04488ced-232c-417b-9ec1-023c34e2a130/node-ca/0.log"
Sep 10 16:08:05.645970 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:05.645940    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5b58d48c-sjl65_7d5966a0-9a10-4dca-b54a-30f8a8804822/kube-auth-proxy/0.log"
Sep 10 16:08:05.795941 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:05.795912    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8646695894-4pgll_6ee431f4-2197-4401-94bb-3810063e3595/router/0.log"
Sep 10 16:08:06.666195 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:06.666162    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7kl4j_c1e17b5c-42fa-4eec-b61a-2eb94a534625/serve-healthcheck-canary/0.log"
Sep 10 16:08:07.213022 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:07.212984    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-lqcpb_6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2/insights-operator/0.log"
Sep 10 16:08:07.213405 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:07.213371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-lqcpb_6ba258b6-95b5-4dd0-8cc8-7f4ec430f1e2/insights-operator/1.log"
Sep 10 16:08:07.232853 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:07.232829    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfrlj_c6af7b99-dc7d-49b1-9ae3-976ee78d7044/kube-rbac-proxy/0.log"
Sep 10 16:08:07.254310 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:07.254280    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfrlj_c6af7b99-dc7d-49b1-9ae3-976ee78d7044/exporter/0.log"
Sep 10 16:08:07.275834 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:07.275803    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gfrlj_c6af7b99-dc7d-49b1-9ae3-976ee78d7044/extractor/0.log"
Sep 10 16:08:08.987095 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:08.987070    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ccz5g/perf-node-gather-daemonset-v24z6"
Sep 10 16:08:10.028479 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:10.028438    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f4cd445f-8xwcd_03a67e64-4565-4af7-bfe9-acfe7fe6d5b4/manager/0.log"
Sep 10 16:08:10.051612 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:10.051590    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f4cd445f-8xwcd_03a67e64-4565-4af7-bfe9-acfe7fe6d5b4/copy-manifests/0.log"
Sep 10 16:08:11.497524 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:11.497490    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-556d846896-qftrq_e170054f-0a47-4b5d-9c32-d5ceee6d55e2/manager/0.log"
Sep 10 16:08:12.360938 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:12.360843    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5b58d48c-sjl65_7d5966a0-9a10-4dca-b54a-30f8a8804822/kube-auth-proxy/0.log"
Sep 10 16:08:12.466489 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:12.466461    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8646695894-4pgll_6ee431f4-2197-4401-94bb-3810063e3595/router/0.log"
Sep 10 16:08:13.502770 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:13.502743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42c4g_214a6aa5-61a6-4d2a-a24e-fc5a440635c2/konnectivity-agent/0.log" limit=1024
Sep 10 16:08:14.282881 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:14.282850    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5b58d48c-sjl65_7d5966a0-9a10-4dca-b54a-30f8a8804822/kube-auth-proxy/0.log"
Sep 10 16:08:14.395232 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:14.395203    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8646695894-4pgll_6ee431f4-2197-4401-94bb-3810063e3595/router/0.log"
Sep 10 16:08:17.241596 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:17.241563    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-v92gt_a01fa180-3e1e-4f71-a28b-4af0c406be76/kube-storage-version-migrator-operator/1.log"
Sep 10 16:08:17.242681 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:17.242651    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-v92gt_a01fa180-3e1e-4f71-a28b-4af0c406be76/kube-storage-version-migrator-operator/0.log"
Sep 10 16:08:18.258490 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.258458    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6ncl_ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b/kube-multus-additional-cni-plugins/0.log"
Sep 10 16:08:18.281777 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.281753    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6ncl_ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b/egress-router-binary-copy/0.log"
Sep 10 16:08:18.301903 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.301875    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6ncl_ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b/cni-plugins/0.log"
Sep 10 16:08:18.323807 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.323782    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6ncl_ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b/bond-cni-plugin/0.log"
Sep 10 16:08:18.343535 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.343518    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6ncl_ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b/routeoverride-cni/0.log"
Sep 10 16:08:18.364401 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.364385    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6ncl_ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b/whereabouts-cni-bincopy/0.log"
Sep 10 16:08:18.383770 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.383750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6ncl_ac6d3a89-325f-4cd6-acc3-cf81e9e2df6b/whereabouts-cni/0.log"
Sep 10 16:08:18.822594 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.822564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qpvtl_85dba1d8-5e98-4ebd-a9af-9ec03a796293/kube-multus/0.log"
Sep 10 16:08:18.844184 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.844152    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5qpdw_b48c88a3-d212-47b7-bb49-118f3d58fb3d/network-metrics-daemon/0.log"
Sep 10 16:08:18.862520 ip-10-0-136-122 kubenswrapper[2565]: I0910 16:08:18.862494    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5qpdw_b48c88a3-d212-47b7-bb49-118f3d58fb3d/kube-rbac-proxy/0.log"