Sep 09 12:11:23.848589 ip-10-0-136-24 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 12:11:24.196060 ip-10-0-136-24 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 12:11:24.196060 ip-10-0-136-24 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 12:11:24.196060 ip-10-0-136-24 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 12:11:24.196060 ip-10-0-136-24 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 12:11:24.196060 ip-10-0-136-24 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 12:11:24.198301 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.198209    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 12:11:24.200929 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200914    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 12:11:24.200929 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200928    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200932    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200936    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200939    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200942    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200945    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200948    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200951    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200953    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200956    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200959    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200961    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200964    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200966    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 12:11:24.200988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.200969    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201016    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201053    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201056    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201059    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201063    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201065    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201068    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201073    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201197    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201234    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201242    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201247    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201255    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201263    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201268    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201273    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201277    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201282    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 12:11:24.201525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201287    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201306    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201311    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201321    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201325    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201329    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201334    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201338    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201343    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201347    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201351    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201355    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201359    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201364    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201368    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201377    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201381    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201386    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201390    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201398    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 12:11:24.202133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201406    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201412    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201416    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201422    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201428    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201433    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201438    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201447    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201451    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201456    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201460    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201464    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201468    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201472    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201476    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201481    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201485    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201498    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201503    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201511    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 12:11:24.202657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201516    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201520    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201524    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201528    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201533    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201537    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201541    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201546    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201550    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201554    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201558    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201563    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201571    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201575    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201579    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201585    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201589    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201595    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201599    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201604    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 12:11:24.203133 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201608    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201612    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201617    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201621    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.201634    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203060    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203070    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203074    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203077    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203081    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203083    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203087    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203089    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203092    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203094    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203098    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203103    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203106    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203109    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 12:11:24.203630 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203111    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203114    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203117    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203119    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203122    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203125    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203127    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203130    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203133    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203137    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203141    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203144    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203148    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203151    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203154    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203156    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203159    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203162    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203164    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203168    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 12:11:24.204114 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203171    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203174    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203176    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203179    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203182    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203184    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203187    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203189    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203192    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203196    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203199    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203202    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203205    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203208    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203210    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203213    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203216    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203219    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203222    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 12:11:24.204619 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203224    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203227    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203230    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203232    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203235    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203237    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203240    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203242    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203245    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203247    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203250    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203253    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203258    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203261    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203263    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203265    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203268    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203270    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203273    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203275    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 12:11:24.205091 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203279    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203281    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203284    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203286    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203307    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203311    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203313    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203316    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203319    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203322    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203324    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203327    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203329    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203332    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203334    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203337    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203340    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203342    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203345    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203347    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 12:11:24.205596 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203350    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203352    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203355    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203357    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203362    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203365    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203709    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203714    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203716    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203719    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203722    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203725    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203728    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203730    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203733    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203735    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203738    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203741    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203743    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203746    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 12:11:24.206076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203748    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203751    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203754    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203756    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203759    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203761    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203764    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203767    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203769    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203772    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203774    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203777    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203779    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203782    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203784    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203787    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203792    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203795    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203797    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203800    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 12:11:24.206580 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203802    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203805    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203807    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203811    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203813    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203816    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203818    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203821    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203824    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203826    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203830    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203834    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203837    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203840    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203842    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203845    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203850    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203853    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203856    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 12:11:24.207094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203859    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203862    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203865    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203868    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203871    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203874    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203877    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203880    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203882    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203887    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203890    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203892    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203895    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203897    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203900    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203903    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203905    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203907    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203910    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 12:11:24.207560 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203912    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203915    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203917    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203920    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203922    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203925    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203935    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203938    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203941    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203943    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203946    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203948    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203951    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203954    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203957    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203959    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203962    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203964    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203967    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203969    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 12:11:24.208024 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203971    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203974    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203978    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203980    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203983    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203985    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.203989    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204061    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204106    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204114    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204118    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204122    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204126    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204130    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204134    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204137    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204140    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204143    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204146    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204149    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204152    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204155    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 12:11:24.208567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204158    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204161    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204167    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204173    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204175    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204179    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204182    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204185    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204189    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204192    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204195    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204198    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204202    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204204    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204207    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204210    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204213    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204226    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204229    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204232    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204234    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204237    2560 flags.go:64] FLAG: --enable-server="true"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204240    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204244    2560 flags.go:64] FLAG: --event-burst="100"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204247    2560 flags.go:64] FLAG: --event-qps="50"
Sep 09 12:11:24.209102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204250    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204253    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204256    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204259    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204262    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204264    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204267    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204270    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204273    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204277    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204280    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204283    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204286    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204301    2560 flags.go:64] FLAG: --feature-gates=""
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204305    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204308    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204311    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204314    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204317    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204320    2560 flags.go:64] FLAG: --help="false"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204324    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204327    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204330    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 12:11:24.209699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204333    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204336    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204345    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204348    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204351    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204354    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204358    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204361    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204364    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204366    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204369    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204372    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204375    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204378    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204380    2560 flags.go:64] FLAG: --lock-file=""
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204383    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204386    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204389    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204398    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204401    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204404    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204407    2560 flags.go:64] FLAG: --logging-format="text"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204410    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204413    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 12:11:24.210328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204415    2560 flags.go:64] FLAG: --manifest-url=""
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204418    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204422    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204425    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204429    2560 flags.go:64] FLAG: --max-pods="110"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204432    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204435    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204438    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204441    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204443    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204446    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204455    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204462    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204465    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204468    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204471    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204473    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204478    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204481    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204484    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204487    2560 flags.go:64] FLAG: --port="10250"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204489    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204492    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02ed0677dc9b75f6f"
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204495    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 09 12:11:24.210928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204498    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204501    2560 flags.go:64] FLAG: --register-node="true"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204505    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204509    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204512    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204514    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204517    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204521    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204524    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204527    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204529    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204532    2560 flags.go:64] FLAG: --runonce="false"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204535    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204538    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204541    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204544    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204546    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204549    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204552    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204555    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204561    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204564    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204567    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204570    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204573    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 12:11:24.211523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204575    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204578    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204583    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204586    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204589    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204593    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204595    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204598    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204601    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204606    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204609    2560 flags.go:64] FLAG: --v="2"
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204612    2560 flags.go:64] FLAG: --version="false"
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204617    2560 flags.go:64] FLAG: --vmodule=""
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204620    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.204624    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204747    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204752    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204755    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204758    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204761    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204765    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204767    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204770    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 12:11:24.212213 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204773    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204775    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204778    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204781    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204783    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204786    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204789    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204792    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204794    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204797    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204799    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204802    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204806    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204809    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204812    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204815    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204818    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204820    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204825    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 12:11:24.212791 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204828    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204830    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204833    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204835    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204838    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204841    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204843    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204845    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204848    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204851    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204854    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204858    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204861    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204864    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204867    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204870    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204873    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204876    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204878    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204881    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 12:11:24.213259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204884    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204886    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204889    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204892    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204894    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204897    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204899    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204902    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204905    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204907    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204910    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204914    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204916    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204920    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204924    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204927    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204929    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204932    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204934    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 12:11:24.213842 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204937    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204939    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204942    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204945    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204948    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204951    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204953    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204956    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204959    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204961    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204964    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204966    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204969    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204972    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204975    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204977    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204980    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204982    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204985    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204988    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 12:11:24.214317 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204990    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204992    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204995    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.204998    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205001    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205004    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205006    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205009    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205011    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205014    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205017    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205019    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.205022    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.205761    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.212358    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 12:11:24.214798 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.212372    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.213118    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.213125    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213178    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213183    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213187    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213190    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213193    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213195    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213198    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213201    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213203    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213206    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213208    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213211    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213213    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213216    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213219    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213221    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213225    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 12:11:24.215170 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213228    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213231    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213233    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213236    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213238    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213241    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213244    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213246    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213249    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213252    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213254    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213257    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213263    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213266    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213270    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213272    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213275    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213278    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213280    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 12:11:24.215678 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213283    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213285    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213288    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213306    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213309    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213312    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213315    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213317    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213320    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213324    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213328    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213331    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213334    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213338    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213340    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213343    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213346    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213348    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213351    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213353    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 12:11:24.216159 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213356    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213360    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213363    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213367    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213369    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213372    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213376    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213379    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213381    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213384    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213386    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213390    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213394    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213397    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213399    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213402    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213404    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213407    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213409    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 12:11:24.216651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213412    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213414    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213417    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213419    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213421    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213424    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213427    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213429    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213432    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213434    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213437    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213439    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213442    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213444    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213447    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213449    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213452    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213454    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213457    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213460    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 12:11:24.217141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213463    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213466    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213468    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213471    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.213476    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213582    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213586    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213589    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213592    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213595    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213598    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213600    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213603    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213606    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 12:11:24.217642 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213608    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213612    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213615    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213618    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213621    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213624    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213627    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213629    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213632    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213635    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213638    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213640    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213643    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213645    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213647    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213650    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213652    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213655    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213658    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213661    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 12:11:24.217988 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213663    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213666    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213668    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213671    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213673    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213676    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213678    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213680    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213683    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213685    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213688    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213690    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213693    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213696    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213700    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213702    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213705    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213708    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213711    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213714    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 12:11:24.218479 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213716    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213719    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213722    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213724    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213727    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213729    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213732    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213734    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213737    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213739    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213742    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213745    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213748    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213750    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213753    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213755    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213758    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213761    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213763    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213766    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 12:11:24.218986 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213768    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213771    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213774    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213776    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213778    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213781    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213783    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213786    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213788    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213791    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213794    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213798    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213801    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213803    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213806    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213808    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213811    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213813    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213815    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 12:11:24.219477 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213818    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213821    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213824    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213826    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213829    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213831    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213834    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213837    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213839    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213842    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:24.213844    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.213849    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.213939    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.215758    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.216507    2560 server.go:1019] "Starting client certificate rotation"
Sep 09 12:11:24.220015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.216600    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 12:11:24.220398 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.216633    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 12:11:24.220398 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.218694    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 12:11:24.220398 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.219771    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 12:11:24.231036 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.231014    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 09 12:11:24.236251 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.236234    2560 log.go:25] "Validated CRI v1 image API"
Sep 09 12:11:24.238422 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.238407    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 12:11:24.241848 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.241830    2560 fs.go:135] Filesystem UUIDs: map[344cc1c3-7c44-4f95-b077-351bc1fff443:/dev/nvme0n1p4 67737336-d812-428d-bcca-56fe5d420598:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 09 12:11:24.241902 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.241848    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 12:11:24.246639 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.246525    2560 manager.go:216] Machine: {Timestamp:2026-09-09 12:11:24.24536664 +0000 UTC m=+0.291491809 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3130199 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c45e97d6bd2b71529de345b857cd3 SystemUUID:ec2c45e9-7d6b-d2b7-1529-de345b857cd3 BootID:7c999e59-871a-4910-95c9-3b9e90ea6d4c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:eb:0c:78:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:eb:0c:78:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:b5:94:fa:ee:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 12:11:24.246639 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.246630    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 12:11:24.246754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.246709    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 12:11:24.248882 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.248856    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 12:11:24.249337 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.249316    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 12:11:24.249475 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.249342    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-24.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 12:11:24.250494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.250482    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 12:11:24.250528 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.250497    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 12:11:24.250528 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.250505    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 12:11:24.251209 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.251197    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 12:11:24.252347 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.252337    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 12:11:24.254934 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.254922    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 12:11:24.255049 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.255039    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 12:11:24.255077 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.255069    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 12:11:24.255104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.255080    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 12:11:24.255104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.255095    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 12:11:24.255104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.255104    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 09 12:11:24.255189 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.255115    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 12:11:24.255501 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.255487    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 12:11:24.255501 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.255509    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 12:11:24.257425 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.257406    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 12:11:24.259413 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.259398    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 12:11:24.259461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.259435    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 12:11:24.259596 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.259585    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 12:11:24.259645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.259603    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 12:11:24.259645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.259612    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 12:11:24.259645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.259618    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 12:11:24.259645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.259626    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 12:11:24.259645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.259633    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 12:11:24.260073 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.260064    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 12:11:24.260073 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.260073    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 12:11:24.260126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.260080    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 12:11:24.260126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.260087    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 12:11:24.260126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.260101    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 12:11:24.260126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.260109    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 12:11:24.260831 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.260821    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 12:11:24.260868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.260832    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 12:11:24.264671 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.264653    2560 server.go:1268] "Started kubelet"
Sep 09 12:11:24.264999 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.264949    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 12:11:24.265094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.265019    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 12:11:24.265601 ip-10-0-136-24 systemd[1]: Started Kubernetes Kubelet.
Sep 09 12:11:24.266800 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.265915    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 12:11:24.268239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.268221    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 12:11:24.268464 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.268445    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 12:11:24.268781 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.268666    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 12:11:24.268781 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.268680    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 12:11:24.269978 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.269961    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 12:11:24.271151 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.271125    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 12:11:24.271704 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.271685    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 12:11:24.272176 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.272150    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 12:11:24.272282 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.272224    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:24.272659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.272642    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 12:11:24.272772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.272666    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 12:11:24.272772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.272642    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 12:11:24.272871 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.272774    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 12:11:24.272871 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.272781    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 12:11:24.273016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.273003    2560 factory.go:55] Registering systemd factory
Sep 09 12:11:24.273061 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.273018    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 09 12:11:24.273209 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.273197    2560 factory.go:153] Registering CRI-O factory
Sep 09 12:11:24.273209 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.273209    2560 factory.go:223] Registration of the crio container factory successfully
Sep 09 12:11:24.273329 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.273253    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 12:11:24.273329 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.273266    2560 factory.go:103] Registering Raw factory
Sep 09 12:11:24.273329 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.273275    2560 manager.go:1196] Started watching for new ooms in manager
Sep 09 12:11:24.273662 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.273648    2560 manager.go:349] Starting recovery of all containers
Sep 09 12:11:24.273825 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.272913    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-24.ec2.internal.18d3a5e6006f0aa0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-24.ec2.internal,UID:ip-10-0-136-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-24.ec2.internal,},FirstTimestamp:2026-09-09 12:11:24.264557216 +0000 UTC m=+0.310682392,LastTimestamp:2026-09-09 12:11:24.264557216 +0000 UTC m=+0.310682392,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-24.ec2.internal,}"
Sep 09 12:11:24.281187 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.281160    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m6g7v"
Sep 09 12:11:24.281644 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.281617    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 12:11:24.281853 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.281834    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 12:11:24.283727 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.283711    2560 manager.go:354] Recovery completed
Sep 09 12:11:24.287906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.287833    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 12:11:24.288177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.288083    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m6g7v"
Sep 09 12:11:24.290439 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.290421    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 12:11:24.290528 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.290456    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 12:11:24.290528 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.290473    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientPID"
Sep 09 12:11:24.291004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.290989    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 12:11:24.291004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.291002    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 12:11:24.291137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.291016    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 12:11:24.291137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.290990    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 12:11:24.291841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.291823    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 12:11:24.291841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.291850    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 12:11:24.291962 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.291859    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientPID"
Sep 09 12:11:24.292195 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.292184    2560 policy_none.go:49] "None policy: Start"
Sep 09 12:11:24.292226 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.292198    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 12:11:24.292226 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.292208    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 12:11:24.292777 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.292702    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-24.ec2.internal.18d3a5e601f9f4cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-24.ec2.internal,UID:ip-10-0-136-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-24.ec2.internal,},FirstTimestamp:2026-09-09 12:11:24.290438347 +0000 UTC m=+0.336563527,LastTimestamp:2026-09-09 12:11:24.290438347 +0000 UTC m=+0.336563527,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-24.ec2.internal,}"
Sep 09 12:11:24.293246 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.293230    2560 policy_none.go:47] "Start"
Sep 09 12:11:24.325011 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.324893    2560 manager.go:337] "Starting Device Plugin manager"
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.325042    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.325056    2560 server.go:87] "Starting device plugin registration server"
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.325272    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.325285    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.325402    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.325491    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.325499    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.325978    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 12:11:24.339767 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.326030    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:24.391683 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.391654    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 12:11:24.392806 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.392781    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 12:11:24.392885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.392841    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 12:11:24.392885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.392866    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 12:11:24.392982 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.392958    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 12:11:24.394873 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.394854    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 12:11:24.425768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.425737    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 12:11:24.426759 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.426744    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 12:11:24.426815 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.426773    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 12:11:24.426815 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.426783    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientPID"
Sep 09 12:11:24.426815 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.426812    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.434770 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.434756    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.434810 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.434777    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-24.ec2.internal\": node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:24.451606 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.451543    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:24.493522 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.493496    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal"]
Sep 09 12:11:24.493609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.493566    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 12:11:24.494983 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.494965    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 12:11:24.495068 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.494997    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 12:11:24.495068 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.495012    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientPID"
Sep 09 12:11:24.496173 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496160    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 12:11:24.496284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496270    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.496344 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496315    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 12:11:24.496798 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496781    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 12:11:24.496868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496808    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 12:11:24.496868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496818    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientPID"
Sep 09 12:11:24.496868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496819    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 12:11:24.496868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496836    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 12:11:24.496868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.496847    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientPID"
Sep 09 12:11:24.497917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.497899    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.497994 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.497925    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 12:11:24.498541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.498528    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 12:11:24.498620 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.498554    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 12:11:24.498620 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.498565    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeHasSufficientPID"
Sep 09 12:11:24.524868 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.524848    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-24.ec2.internal\" not found" node="ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.529249 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.529235    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-24.ec2.internal\" not found" node="ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.551777 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.551759    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:24.575207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.575188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c16cf88aa13a1d31a699b5b3eff900e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-24.ec2.internal\" (UID: \"c16cf88aa13a1d31a699b5b3eff900e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.575267 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.575212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91592842fef0a05b231ae98adb9b5dae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal\" (UID: \"91592842fef0a05b231ae98adb9b5dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.575267 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.575229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91592842fef0a05b231ae98adb9b5dae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal\" (UID: \"91592842fef0a05b231ae98adb9b5dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.652519 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.652496    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:24.676381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.676350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c16cf88aa13a1d31a699b5b3eff900e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-24.ec2.internal\" (UID: \"c16cf88aa13a1d31a699b5b3eff900e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.676381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.676381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91592842fef0a05b231ae98adb9b5dae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal\" (UID: \"91592842fef0a05b231ae98adb9b5dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.676507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.676400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91592842fef0a05b231ae98adb9b5dae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal\" (UID: \"91592842fef0a05b231ae98adb9b5dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.676507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.676459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c16cf88aa13a1d31a699b5b3eff900e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-24.ec2.internal\" (UID: \"c16cf88aa13a1d31a699b5b3eff900e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.676507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.676473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91592842fef0a05b231ae98adb9b5dae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal\" (UID: \"91592842fef0a05b231ae98adb9b5dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.676507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.676477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91592842fef0a05b231ae98adb9b5dae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal\" (UID: \"91592842fef0a05b231ae98adb9b5dae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.752651 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.752588    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:24.827159 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.827133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.831898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:24.831881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:24.853439 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.853413    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:24.953995 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:24.953952    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:25.054469 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:25.054401    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:25.154529 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:25.154496    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:25.217231 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.217206    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 12:11:25.217729 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.217398    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 12:11:25.255289 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:25.255255    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-24.ec2.internal\" not found"
Sep 09 12:11:25.285806 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.285783    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 12:11:25.290957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.290919    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 12:06:24 +0000 UTC" deadline="2028-02-08 00:54:07.525549255 +0000 UTC"
Sep 09 12:11:25.290957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.290954    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12396h42m42.234599942s"
Sep 09 12:11:25.293233 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.293209    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 12:11:25.372664 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.372645    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:25.382529 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:25.382497    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16cf88aa13a1d31a699b5b3eff900e5.slice/crio-968f68330c8bf58229954a7b6864500143313e48d4be6d2e71c39637cf6ff4e2 WatchSource:0}: Error finding container 968f68330c8bf58229954a7b6864500143313e48d4be6d2e71c39637cf6ff4e2: Status 404 returned error can't find the container with id 968f68330c8bf58229954a7b6864500143313e48d4be6d2e71c39637cf6ff4e2
Sep 09 12:11:25.382756 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:25.382735    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91592842fef0a05b231ae98adb9b5dae.slice/crio-8354cd19307e2b2e2c5ce3cb0c891643a399561c97d9e75d0040bd466fb47eac WatchSource:0}: Error finding container 8354cd19307e2b2e2c5ce3cb0c891643a399561c97d9e75d0040bd466fb47eac: Status 404 returned error can't find the container with id 8354cd19307e2b2e2c5ce3cb0c891643a399561c97d9e75d0040bd466fb47eac
Sep 09 12:11:25.386704 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.386678    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 12:11:25.387745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.387721    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 12:11:25.388747 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.388732    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal"
Sep 09 12:11:25.398618 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.398574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal" event={"ID":"91592842fef0a05b231ae98adb9b5dae","Type":"ContainerStarted","Data":"8354cd19307e2b2e2c5ce3cb0c891643a399561c97d9e75d0040bd466fb47eac"}
Sep 09 12:11:25.399713 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.399693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal" event={"ID":"c16cf88aa13a1d31a699b5b3eff900e5","Type":"ContainerStarted","Data":"968f68330c8bf58229954a7b6864500143313e48d4be6d2e71c39637cf6ff4e2"}
Sep 09 12:11:25.400593 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.400578    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 12:11:25.498269 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:25.498244    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 12:11:26.257708 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.257677    2560 apiserver.go:52] "Watching apiserver"
Sep 09 12:11:26.266741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.266717    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 12:11:26.268921 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.268884    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9k524","kube-system/konnectivity-agent-94q8q","kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs","openshift-dns/node-resolver-gcfhg","openshift-image-registry/node-ca-phnkk","openshift-multus/multus-additional-cni-plugins-td2j6","openshift-multus/network-metrics-daemon-6mbr9","openshift-cluster-node-tuning-operator/tuned-h8tj8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal","openshift-multus/multus-t7q7p","openshift-network-diagnostics/network-check-target-7km7f","openshift-network-operator/iptables-alerter-zlvzs","openshift-ovn-kubernetes/ovnkube-node-44tg8"]
Sep 09 12:11:26.270540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.270515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.271754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.271721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.272725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.272704    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 12:11:26.272979 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.272952    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7gp54\""
Sep 09 12:11:26.273077 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.273048    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 12:11:26.273193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.273159    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 12:11:26.273193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.273172    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 12:11:26.273407 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.273243    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 12:11:26.273640 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.273618    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.273771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.273745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 12:11:26.274263 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.274244    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 12:11:26.274457 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.274442    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cndk5\""
Sep 09 12:11:26.274532 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.274492    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 12:11:26.275025 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.275003    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.276381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.276283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.276534 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.276514    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 12:11:26.276669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.276652    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 12:11:26.276757 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.276745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 12:11:26.278839 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.277685    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 12:11:26.278839 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.278271    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 12:11:26.278839 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.278724    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 12:11:26.279042 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.278954    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 12:11:26.279715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.279426    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 12:11:26.279715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.279531    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 12:11:26.279715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.279668    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d7w86\""
Sep 09 12:11:26.279917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.279802    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k9gnl\""
Sep 09 12:11:26.279973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.279942    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-76cm8\""
Sep 09 12:11:26.279973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.279952    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 12:11:26.280195 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.280173    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 12:11:26.280587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.280568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.282079 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.281966    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 12:11:26.282612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.282574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.283906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.283886    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 12:11:26.284119 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.284100    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 12:11:26.284189 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.284137    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vddw5\""
Sep 09 12:11:26.284234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.284193    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 12:11:26.285112 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-cnibin\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.285211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.285211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-systemd-units\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-slash\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovnkube-script-lib\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhzbl\" (UniqueName: \"kubernetes.io/projected/314da134-39ef-45e0-a464-d1819f7105f5-kube-api-access-zhzbl\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.285462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mm5v\" (UniqueName: \"kubernetes.io/projected/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-kube-api-access-4mm5v\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.285462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovn-node-metrics-cert\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.285462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-iptables-alerter-script\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.285462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-kubelet\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-etc-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-ovn\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285591    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-system-cni-dir\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.285668    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-cni-netd\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.285808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-run-netns\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-systemd\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-node-log\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovnkube-config\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwp7j\" (UniqueName: \"kubernetes.io/projected/dbd83909-6943-4c36-b38a-74493ca5b9a7-kube-api-access-dwp7j\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-host-slash\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.285963    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jhk46\""
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.286031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-var-lib-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.286055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-log-socket\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.286075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-cni-bin\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.286097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-env-overrides\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.286227    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 12:11:26.286456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.286353    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 12:11:26.287097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.286977    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:26.288705 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.288683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:26.288804 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.288745    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:26.288804 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.288792    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 12:11:26.289128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.289109    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 12:11:26.289456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.289443    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9lb5h\""
Sep 09 12:11:26.289543 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.289473    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 12:11:26.290521 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.290502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.292164 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.292144    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:26.292243 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.292227    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:26.292918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.292900    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 12:11:26.293007 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.292904    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g92kb\""
Sep 09 12:11:26.313506 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.313485    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xz29h"
Sep 09 12:11:26.324030 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.324007    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xz29h"
Sep 09 12:11:26.374393 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.374370    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 12:11:26.386371 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6s85\" (UniqueName: \"kubernetes.io/projected/1d310f15-0c20-4804-b322-3429f9cf5096-kube-api-access-p6s85\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.386488 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.386488 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovnkube-config\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386488 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwp7j\" (UniqueName: \"kubernetes.io/projected/dbd83909-6943-4c36-b38a-74493ca5b9a7-kube-api-access-dwp7j\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386632 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d310f15-0c20-4804-b322-3429f9cf5096-host\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.386632 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lb5\" (UniqueName: \"kubernetes.io/projected/e4e6cf39-498b-441b-8c5f-4ab1851f60da-kube-api-access-r6lb5\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:26.386720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-host-slash\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.386720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-var-lib-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386681    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-log-socket\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-cni-bin\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-host-slash\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-registration-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-cni-bin\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-cnibin\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-var-lib-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-log-socket\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-multus-certs\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-slash\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovnkube-script-lib\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4xxr\" (UniqueName: \"kubernetes.io/projected/71e54cc6-103c-47d9-b9ac-087705124117-kube-api-access-t4xxr\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhzbl\" (UniqueName: \"kubernetes.io/projected/314da134-39ef-45e0-a464-d1819f7105f5-kube-api-access-zhzbl\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.386938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386942    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-slash\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.387519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mm5v\" (UniqueName: \"kubernetes.io/projected/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-kube-api-access-4mm5v\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.387519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.386988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.387519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovn-node-metrics-cert\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.387519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysconfig\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.387519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysctl-conf\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.387519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.387519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d96a723f-56e9-4550-92c9-abe553637eee-dbus\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.387519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387498    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.387893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-hostroot\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.387893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-iptables-alerter-script\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.387893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-kubelet\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.387893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-sys\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.387893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-cni-multus\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.387893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-kubelet\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.387893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovnkube-config\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.387893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-kubelet\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.388251 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-daemon-config\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.388251 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.387952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-etc-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.388376 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.388631 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-etc-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.388694 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-lib-modules\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.388694 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-netns\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.388790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-system-cni-dir\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.388790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-iptables-alerter-script\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.388790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-openvswitch\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.388790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.388989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388790    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 12:11:26.388989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovnkube-script-lib\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.388989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-cni-netd\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.388989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-cni-netd\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.388989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-run\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.388989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-system-cni-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.388989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-system-cni-dir\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.388989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.388945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4np6\" (UniqueName: \"kubernetes.io/projected/e382006f-225e-4c5e-bfd6-81396a7f4987-kube-api-access-v4np6\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-run-netns\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-systemd\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-systemd\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389235    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-socket-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-run-netns\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6bt\" (UniqueName: \"kubernetes.io/projected/2997c875-d03c-4d20-9dc7-6ade576be613-kube-api-access-nm6bt\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-env-overrides\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.389414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389354    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-systemd\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d310f15-0c20-4804-b322-3429f9cf5096-serviceca\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysctl-d\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d96a723f-56e9-4550-92c9-abe553637eee-kubelet-config\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-sys-fs\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-conf-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-cnibin\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-systemd-units\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-host\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71e54cc6-103c-47d9-b9ac-087705124117-etc-tuned\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-etc-selinux\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8448f14b-521e-498f-b39c-0f892bc3e915-agent-certs\") pod \"konnectivity-agent-94q8q\" (UID: \"8448f14b-521e-498f-b39c-0f892bc3e915\") " pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-socket-dir-parent\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.389881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-cnibin\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389903    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-systemd-units\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.389922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2997c875-d03c-4d20-9dc7-6ade576be613-tmp-dir\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-var-lib-kubelet\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-cni-bin\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dbd83909-6943-4c36-b38a-74493ca5b9a7-env-overrides\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-device-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-cni-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-k8s-cni-cncf-io\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-ovn\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.390515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2997c875-d03c-4d20-9dc7-6ade576be613-hosts-file\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-modprobe-d\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-kubernetes\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8448f14b-521e-498f-b39c-0f892bc3e915-konnectivity-ca\") pod \"konnectivity-agent-94q8q\" (UID: \"8448f14b-521e-498f-b39c-0f892bc3e915\") " pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e382006f-225e-4c5e-bfd6-81396a7f4987-cni-binary-copy\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71e54cc6-103c-47d9-b9ac-087705124117-tmp\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/314da134-39ef-45e0-a464-d1819f7105f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgvx6\" (UniqueName: \"kubernetes.io/projected/2fbe76db-b933-4da2-b8df-18ac407d685e-kube-api-access-zgvx6\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.390988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-etc-kubernetes\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.391016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.391008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-run-ovn\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.391701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.391062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-node-log\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.391701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.391166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dbd83909-6943-4c36-b38a-74493ca5b9a7-node-log\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.391701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.391324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/314da134-39ef-45e0-a464-d1819f7105f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.395322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.395294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dbd83909-6943-4c36-b38a-74493ca5b9a7-ovn-node-metrics-cert\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.397458 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.397426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwp7j\" (UniqueName: \"kubernetes.io/projected/dbd83909-6943-4c36-b38a-74493ca5b9a7-kube-api-access-dwp7j\") pod \"ovnkube-node-44tg8\" (UID: \"dbd83909-6943-4c36-b38a-74493ca5b9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.399332 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.399306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mm5v\" (UniqueName: \"kubernetes.io/projected/0ba8416f-630f-4a82-b8eb-3ac9aa1620e3-kube-api-access-4mm5v\") pod \"iptables-alerter-zlvzs\" (UID: \"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3\") " pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.399817 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.399795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhzbl\" (UniqueName: \"kubernetes.io/projected/314da134-39ef-45e0-a464-d1819f7105f5-kube-api-access-zhzbl\") pod \"multus-additional-cni-plugins-td2j6\" (UID: \"314da134-39ef-45e0-a464-d1819f7105f5\") " pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.491402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-device-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.491402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-cni-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.491633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-k8s-cni-cncf-io\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.491633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2997c875-d03c-4d20-9dc7-6ade576be613-hosts-file\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.491633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-modprobe-d\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.491633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-kubernetes\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.491633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-device-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.491633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-k8s-cni-cncf-io\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.491633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-cni-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.491633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8448f14b-521e-498f-b39c-0f892bc3e915-konnectivity-ca\") pod \"konnectivity-agent-94q8q\" (UID: \"8448f14b-521e-498f-b39c-0f892bc3e915\") " pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-kubernetes\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e382006f-225e-4c5e-bfd6-81396a7f4987-cni-binary-copy\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2997c875-d03c-4d20-9dc7-6ade576be613-hosts-file\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491692    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-modprobe-d\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491752    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71e54cc6-103c-47d9-b9ac-087705124117-tmp\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgvx6\" (UniqueName: \"kubernetes.io/projected/2fbe76db-b933-4da2-b8df-18ac407d685e-kube-api-access-zgvx6\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-etc-kubernetes\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-etc-kubernetes\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.491941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6s85\" (UniqueName: \"kubernetes.io/projected/1d310f15-0c20-4804-b322-3429f9cf5096-kube-api-access-p6s85\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.492102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d310f15-0c20-4804-b322-3429f9cf5096-host\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lb5\" (UniqueName: \"kubernetes.io/projected/e4e6cf39-498b-441b-8c5f-4ab1851f60da-kube-api-access-r6lb5\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-registration-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-cnibin\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-multus-certs\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8448f14b-521e-498f-b39c-0f892bc3e915-konnectivity-ca\") pod \"konnectivity-agent-94q8q\" (UID: \"8448f14b-521e-498f-b39c-0f892bc3e915\") " pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4xxr\" (UniqueName: \"kubernetes.io/projected/71e54cc6-103c-47d9-b9ac-087705124117-kube-api-access-t4xxr\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.492264    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysconfig\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492304    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysctl-conf\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-registration-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.492377    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs podName:e4e6cf39-498b-441b-8c5f-4ab1851f60da nodeName:}" failed. No retries permitted until 2026-09-09 12:11:26.992318152 +0000 UTC m=+3.038443310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs") pod "network-metrics-daemon-6mbr9" (UID: "e4e6cf39-498b-441b-8c5f-4ab1851f60da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e382006f-225e-4c5e-bfd6-81396a7f4987-cni-binary-copy\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d96a723f-56e9-4550-92c9-abe553637eee-dbus\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.492427    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-hostroot\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-multus-certs\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-sys\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.492850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysctl-conf\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.492478    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret podName:d96a723f-56e9-4550-92c9-abe553637eee nodeName:}" failed. No retries permitted until 2026-09-09 12:11:26.992461252 +0000 UTC m=+3.038586413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret") pod "global-pull-secret-syncer-9k524" (UID: "d96a723f-56e9-4550-92c9-abe553637eee") : object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492490    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-cnibin\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-cni-multus\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-kubelet\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysconfig\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-daemon-config\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-sys\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d310f15-0c20-4804-b322-3429f9cf5096-host\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-lib-modules\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492607    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-cni-multus\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-kubelet\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-netns\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-run-netns\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-run\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d96a723f-56e9-4550-92c9-abe553637eee-dbus\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-hostroot\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.493842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492708    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-system-cni-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4np6\" (UniqueName: \"kubernetes.io/projected/e382006f-225e-4c5e-bfd6-81396a7f4987-kube-api-access-v4np6\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-run\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-system-cni-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-systemd\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-lib-modules\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-socket-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-systemd\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6bt\" (UniqueName: \"kubernetes.io/projected/2997c875-d03c-4d20-9dc7-6ade576be613-kube-api-access-nm6bt\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d310f15-0c20-4804-b322-3429f9cf5096-serviceca\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-socket-dir\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysctl-d\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.492983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d96a723f-56e9-4550-92c9-abe553637eee-kubelet-config\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-daemon-config\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-sys-fs\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-conf-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d96a723f-56e9-4550-92c9-abe553637eee-kubelet-config\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.494846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-host\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71e54cc6-103c-47d9-b9ac-087705124117-etc-tuned\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-host\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-etc-sysctl-d\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-etc-selinux\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8448f14b-521e-498f-b39c-0f892bc3e915-agent-certs\") pod \"konnectivity-agent-94q8q\" (UID: \"8448f14b-521e-498f-b39c-0f892bc3e915\") " pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-sys-fs\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-conf-dir\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-socket-dir-parent\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2997c875-d03c-4d20-9dc7-6ade576be613-tmp-dir\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fbe76db-b933-4da2-b8df-18ac407d685e-etc-selinux\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-var-lib-kubelet\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-cni-bin\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-multus-socket-dir-parent\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e382006f-225e-4c5e-bfd6-81396a7f4987-host-var-lib-cni-bin\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d310f15-0c20-4804-b322-3429f9cf5096-serviceca\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71e54cc6-103c-47d9-b9ac-087705124117-var-lib-kubelet\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.493652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2997c875-d03c-4d20-9dc7-6ade576be613-tmp-dir\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.495766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.495103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71e54cc6-103c-47d9-b9ac-087705124117-tmp\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.496391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.495580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71e54cc6-103c-47d9-b9ac-087705124117-etc-tuned\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.496391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.496003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8448f14b-521e-498f-b39c-0f892bc3e915-agent-certs\") pod \"konnectivity-agent-94q8q\" (UID: \"8448f14b-521e-498f-b39c-0f892bc3e915\") " pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:26.504855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.504833    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 12:11:26.509491 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.509434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgvx6\" (UniqueName: \"kubernetes.io/projected/2fbe76db-b933-4da2-b8df-18ac407d685e-kube-api-access-zgvx6\") pod \"aws-ebs-csi-driver-node-s76bs\" (UID: \"2fbe76db-b933-4da2-b8df-18ac407d685e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.514334 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.514309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6s85\" (UniqueName: \"kubernetes.io/projected/1d310f15-0c20-4804-b322-3429f9cf5096-kube-api-access-p6s85\") pod \"node-ca-phnkk\" (UID: \"1d310f15-0c20-4804-b322-3429f9cf5096\") " pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.514961 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.514698    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 12:11:26.514961 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.514725    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 12:11:26.514961 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.514741    2560 projected.go:196] Error preparing data for projected volume kube-api-access-xxkkf for pod openshift-network-diagnostics/network-check-target-7km7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:26.514961 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.514752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4xxr\" (UniqueName: \"kubernetes.io/projected/71e54cc6-103c-47d9-b9ac-087705124117-kube-api-access-t4xxr\") pod \"tuned-h8tj8\" (UID: \"71e54cc6-103c-47d9-b9ac-087705124117\") " pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.514961 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.514829    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf podName:795dad27-1e8b-43c8-9357-8896d43bc9db nodeName:}" failed. No retries permitted until 2026-09-09 12:11:27.014808403 +0000 UTC m=+3.060933579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xxkkf" (UniqueName: "kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf") pod "network-check-target-7km7f" (UID: "795dad27-1e8b-43c8-9357-8896d43bc9db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:26.516557 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.516534    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lb5\" (UniqueName: \"kubernetes.io/projected/e4e6cf39-498b-441b-8c5f-4ab1851f60da-kube-api-access-r6lb5\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:26.517474 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.517453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4np6\" (UniqueName: \"kubernetes.io/projected/e382006f-225e-4c5e-bfd6-81396a7f4987-kube-api-access-v4np6\") pod \"multus-t7q7p\" (UID: \"e382006f-225e-4c5e-bfd6-81396a7f4987\") " pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.517596 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.517577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6bt\" (UniqueName: \"kubernetes.io/projected/2997c875-d03c-4d20-9dc7-6ade576be613-kube-api-access-nm6bt\") pod \"node-resolver-gcfhg\" (UID: \"2997c875-d03c-4d20-9dc7-6ade576be613\") " pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.584362 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.584324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-td2j6"
Sep 09 12:11:26.595499 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.595473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zlvzs"
Sep 09 12:11:26.603515 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.603488    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:26.609424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.609406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs"
Sep 09 12:11:26.616442 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.616420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcfhg"
Sep 09 12:11:26.624106 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.624088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-phnkk"
Sep 09 12:11:26.631030 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.631015    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8tj8"
Sep 09 12:11:26.638978 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.638958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:26.644001 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.643981    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t7q7p"
Sep 09 12:11:26.798262 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:26.798235    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8448f14b_521e_498f_b39c_0f892bc3e915.slice/crio-b77e10f9889796ce75f013753fb6023d07423dd59b8a35bc3befaffcf8094e36 WatchSource:0}: Error finding container b77e10f9889796ce75f013753fb6023d07423dd59b8a35bc3befaffcf8094e36: Status 404 returned error can't find the container with id b77e10f9889796ce75f013753fb6023d07423dd59b8a35bc3befaffcf8094e36
Sep 09 12:11:26.801458 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:26.801431    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2997c875_d03c_4d20_9dc7_6ade576be613.slice/crio-992f8567be83eb7fc4efad6e645d01c172f16d550f3c3b229e3835d4a0694698 WatchSource:0}: Error finding container 992f8567be83eb7fc4efad6e645d01c172f16d550f3c3b229e3835d4a0694698: Status 404 returned error can't find the container with id 992f8567be83eb7fc4efad6e645d01c172f16d550f3c3b229e3835d4a0694698
Sep 09 12:11:26.806795 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:26.806617    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd83909_6943_4c36_b38a_74493ca5b9a7.slice/crio-241dd4880cc31fb28b56e251d927b8e68ffeb19e60a7c3d062ef075c2139d2eb WatchSource:0}: Error finding container 241dd4880cc31fb28b56e251d927b8e68ffeb19e60a7c3d062ef075c2139d2eb: Status 404 returned error can't find the container with id 241dd4880cc31fb28b56e251d927b8e68ffeb19e60a7c3d062ef075c2139d2eb
Sep 09 12:11:26.809251 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:26.808809    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314da134_39ef_45e0_a464_d1819f7105f5.slice/crio-4f26fffc32a619fb801baf0cd94e14ede76bcfb1c74730abcadc4a4dded1335a WatchSource:0}: Error finding container 4f26fffc32a619fb801baf0cd94e14ede76bcfb1c74730abcadc4a4dded1335a: Status 404 returned error can't find the container with id 4f26fffc32a619fb801baf0cd94e14ede76bcfb1c74730abcadc4a4dded1335a
Sep 09 12:11:26.809251 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:11:26.809097    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode382006f_225e_4c5e_bfd6_81396a7f4987.slice/crio-34c6a308acd7cc7d6902289b3e5cade633c4f379476f250459c4b9e952a1d746 WatchSource:0}: Error finding container 34c6a308acd7cc7d6902289b3e5cade633c4f379476f250459c4b9e952a1d746: Status 404 returned error can't find the container with id 34c6a308acd7cc7d6902289b3e5cade633c4f379476f250459c4b9e952a1d746
Sep 09 12:11:26.996689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.996440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:26.996689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:26.996692    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:26.996933 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.996631    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:26.996933 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.996804    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs podName:e4e6cf39-498b-441b-8c5f-4ab1851f60da nodeName:}" failed. No retries permitted until 2026-09-09 12:11:27.996788878 +0000 UTC m=+4.042914039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs") pod "network-metrics-daemon-6mbr9" (UID: "e4e6cf39-498b-441b-8c5f-4ab1851f60da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:26.996933 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.996821    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:26.996933 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:26.996877    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret podName:d96a723f-56e9-4550-92c9-abe553637eee nodeName:}" failed. No retries permitted until 2026-09-09 12:11:27.996859638 +0000 UTC m=+4.042984802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret") pod "global-pull-secret-syncer-9k524" (UID: "d96a723f-56e9-4550-92c9-abe553637eee") : object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:27.097343 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.097295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:27.097492 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:27.097462    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 12:11:27.097549 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:27.097494    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 12:11:27.097549 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:27.097507    2560 projected.go:196] Error preparing data for projected volume kube-api-access-xxkkf for pod openshift-network-diagnostics/network-check-target-7km7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:27.097636 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:27.097566    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf podName:795dad27-1e8b-43c8-9357-8896d43bc9db nodeName:}" failed. No retries permitted until 2026-09-09 12:11:28.097546339 +0000 UTC m=+4.143671511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxkkf" (UniqueName: "kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf") pod "network-check-target-7km7f" (UID: "795dad27-1e8b-43c8-9357-8896d43bc9db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:27.327457 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.327257    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 12:06:26 +0000 UTC" deadline="2028-05-04 04:15:19.859680336 +0000 UTC"
Sep 09 12:11:27.327457 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.327336    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14464h3m52.532348437s"
Sep 09 12:11:27.405102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.405059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs" event={"ID":"2fbe76db-b933-4da2-b8df-18ac407d685e","Type":"ContainerStarted","Data":"3979ef94fcc753a18185ede4ac96542b46e91ddc0c90c858dc401af3ff87a037"}
Sep 09 12:11:27.407525 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.407493    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td2j6" event={"ID":"314da134-39ef-45e0-a464-d1819f7105f5","Type":"ContainerStarted","Data":"4f26fffc32a619fb801baf0cd94e14ede76bcfb1c74730abcadc4a4dded1335a"}
Sep 09 12:11:27.409085 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.409056    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"241dd4880cc31fb28b56e251d927b8e68ffeb19e60a7c3d062ef075c2139d2eb"}
Sep 09 12:11:27.411309 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.411269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-94q8q" event={"ID":"8448f14b-521e-498f-b39c-0f892bc3e915","Type":"ContainerStarted","Data":"b77e10f9889796ce75f013753fb6023d07423dd59b8a35bc3befaffcf8094e36"}
Sep 09 12:11:27.415454 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.414723    2560 generic.go:356] "Generic (PLEG): container finished" podID="91592842fef0a05b231ae98adb9b5dae" containerID="fcfb3e5b565ae09ef715b0632a0775df5e701d8913a36dd25da22ca72275b025" exitCode=0
Sep 09 12:11:27.415454 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.414792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal" event={"ID":"91592842fef0a05b231ae98adb9b5dae","Type":"ContainerDied","Data":"fcfb3e5b565ae09ef715b0632a0775df5e701d8913a36dd25da22ca72275b025"}
Sep 09 12:11:27.417202 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.417136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8tj8" event={"ID":"71e54cc6-103c-47d9-b9ac-087705124117","Type":"ContainerStarted","Data":"9de1394a2fbb000d32c3dd5acc2e364449a028bfa8bb36f3a385c5f7f874db3d"}
Sep 09 12:11:27.420885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.420809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zlvzs" event={"ID":"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3","Type":"ContainerStarted","Data":"0eff78fbabdff88602e18edd1282524857d2de9e044dd9f9aa674ab7f7c05815"}
Sep 09 12:11:27.425137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.425102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-phnkk" event={"ID":"1d310f15-0c20-4804-b322-3429f9cf5096","Type":"ContainerStarted","Data":"7e1ed0729b34817a9c3fc46fc47b09b8390ba2329a6683490ecf0a0eb9357c6b"}
Sep 09 12:11:27.427663 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.427606    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t7q7p" event={"ID":"e382006f-225e-4c5e-bfd6-81396a7f4987","Type":"ContainerStarted","Data":"34c6a308acd7cc7d6902289b3e5cade633c4f379476f250459c4b9e952a1d746"}
Sep 09 12:11:27.429590 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:27.429539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcfhg" event={"ID":"2997c875-d03c-4d20-9dc7-6ade576be613","Type":"ContainerStarted","Data":"992f8567be83eb7fc4efad6e645d01c172f16d550f3c3b229e3835d4a0694698"}
Sep 09 12:11:28.005278 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.005183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:28.005278 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.005235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:28.005521 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.005413    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:28.005521 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.005475    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret podName:d96a723f-56e9-4550-92c9-abe553637eee nodeName:}" failed. No retries permitted until 2026-09-09 12:11:30.005457181 +0000 UTC m=+6.051582341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret") pod "global-pull-secret-syncer-9k524" (UID: "d96a723f-56e9-4550-92c9-abe553637eee") : object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:28.005892 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.005856    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:28.006004 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.005925    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs podName:e4e6cf39-498b-441b-8c5f-4ab1851f60da nodeName:}" failed. No retries permitted until 2026-09-09 12:11:30.005910009 +0000 UTC m=+6.052035174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs") pod "network-metrics-daemon-6mbr9" (UID: "e4e6cf39-498b-441b-8c5f-4ab1851f60da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:28.106002 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.105965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:28.106178 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.106127    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 12:11:28.106178 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.106149    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 12:11:28.106178 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.106160    2560 projected.go:196] Error preparing data for projected volume kube-api-access-xxkkf for pod openshift-network-diagnostics/network-check-target-7km7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:28.106373 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.106204    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf podName:795dad27-1e8b-43c8-9357-8896d43bc9db nodeName:}" failed. No retries permitted until 2026-09-09 12:11:30.106191857 +0000 UTC m=+6.152317012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxkkf" (UniqueName: "kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf") pod "network-check-target-7km7f" (UID: "795dad27-1e8b-43c8-9357-8896d43bc9db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:28.327773 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.327656    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 12:06:26 +0000 UTC" deadline="2028-05-14 20:13:38.442719991 +0000 UTC"
Sep 09 12:11:28.327773 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.327696    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14720h2m10.115028735s"
Sep 09 12:11:28.393384 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.393339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:28.393558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.393352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:28.393558 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.393472    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:28.393558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.393498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:28.393709 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.393594    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:28.393709 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:28.393667    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:28.446771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:28.446734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal" event={"ID":"91592842fef0a05b231ae98adb9b5dae","Type":"ContainerStarted","Data":"daf65c4222a68bee2f98cd82b4bcc966d2ff5435e6db73744280ca87c46cf616"}
Sep 09 12:11:30.022496 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:30.022460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:30.023069 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:30.022513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:30.023069 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.022675    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:30.023069 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.022733    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret podName:d96a723f-56e9-4550-92c9-abe553637eee nodeName:}" failed. No retries permitted until 2026-09-09 12:11:34.022715312 +0000 UTC m=+10.068840480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret") pod "global-pull-secret-syncer-9k524" (UID: "d96a723f-56e9-4550-92c9-abe553637eee") : object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:30.023469 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.023448    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:30.023563 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.023502    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs podName:e4e6cf39-498b-441b-8c5f-4ab1851f60da nodeName:}" failed. No retries permitted until 2026-09-09 12:11:34.023486303 +0000 UTC m=+10.069611461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs") pod "network-metrics-daemon-6mbr9" (UID: "e4e6cf39-498b-441b-8c5f-4ab1851f60da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:30.123460 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:30.123428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:30.123627 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.123604    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 12:11:30.123627 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.123625    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 12:11:30.123766 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.123637    2560 projected.go:196] Error preparing data for projected volume kube-api-access-xxkkf for pod openshift-network-diagnostics/network-check-target-7km7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:30.123766 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.123692    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf podName:795dad27-1e8b-43c8-9357-8896d43bc9db nodeName:}" failed. No retries permitted until 2026-09-09 12:11:34.123674649 +0000 UTC m=+10.169799812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxkkf" (UniqueName: "kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf") pod "network-check-target-7km7f" (UID: "795dad27-1e8b-43c8-9357-8896d43bc9db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:30.394321 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:30.394232    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:30.394445 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.394392    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:30.395096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:30.394766    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:30.395096 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.394871    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:30.395096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:30.394962    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:30.395096 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:30.395030    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:32.394189 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:32.394158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:32.394657 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:32.394270    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:32.394657 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:32.394283    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:32.394657 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:32.394414    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:32.394657 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:32.394166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:32.394657 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:32.394521    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:34.056106 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:34.056018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:34.056106 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:34.056068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:34.056618 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.056208    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:34.056618 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.056274    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret podName:d96a723f-56e9-4550-92c9-abe553637eee nodeName:}" failed. No retries permitted until 2026-09-09 12:11:42.056256143 +0000 UTC m=+18.102381301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret") pod "global-pull-secret-syncer-9k524" (UID: "d96a723f-56e9-4550-92c9-abe553637eee") : object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:34.056732 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.056708    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:34.056780 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.056761    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs podName:e4e6cf39-498b-441b-8c5f-4ab1851f60da nodeName:}" failed. No retries permitted until 2026-09-09 12:11:42.056744324 +0000 UTC m=+18.102869480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs") pod "network-metrics-daemon-6mbr9" (UID: "e4e6cf39-498b-441b-8c5f-4ab1851f60da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:34.156980 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:34.156901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:34.157130 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.157065    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 12:11:34.157130 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.157094    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 12:11:34.157130 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.157108    2560 projected.go:196] Error preparing data for projected volume kube-api-access-xxkkf for pod openshift-network-diagnostics/network-check-target-7km7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:34.157270 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.157172    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf podName:795dad27-1e8b-43c8-9357-8896d43bc9db nodeName:}" failed. No retries permitted until 2026-09-09 12:11:42.157152612 +0000 UTC m=+18.203277781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxkkf" (UniqueName: "kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf") pod "network-check-target-7km7f" (UID: "795dad27-1e8b-43c8-9357-8896d43bc9db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:34.393833 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:34.393745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:34.393983 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.393898    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:34.394059 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:34.394007    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:34.395266 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.395074    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:34.395266 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:34.395149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:34.395266 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:34.395222    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:36.394146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:36.394114    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:36.394755 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:36.394123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:36.394755 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:36.394287    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:36.394755 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:36.394320    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:36.394755 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:36.394453    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:36.394755 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:36.394539    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:38.393897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:38.393861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:38.393897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:38.393900    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:38.393897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:38.393909    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:38.394501 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:38.394031    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:38.394501 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:38.394112    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:38.394501 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:38.394197    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:40.393768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:40.393733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:40.394225 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:40.393738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:40.394225 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:40.393854    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:40.394225 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:40.393874    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:40.394225 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:40.393999    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:40.394225 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:40.394081    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:42.119179 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:42.119140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:42.119179 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:42.119186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:42.119720 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.119313    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:42.119720 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.119373    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret podName:d96a723f-56e9-4550-92c9-abe553637eee nodeName:}" failed. No retries permitted until 2026-09-09 12:11:58.119357387 +0000 UTC m=+34.165482543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret") pod "global-pull-secret-syncer-9k524" (UID: "d96a723f-56e9-4550-92c9-abe553637eee") : object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:42.119720 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.119313    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:42.119720 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.119445    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs podName:e4e6cf39-498b-441b-8c5f-4ab1851f60da nodeName:}" failed. No retries permitted until 2026-09-09 12:11:58.11943108 +0000 UTC m=+34.165556250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs") pod "network-metrics-daemon-6mbr9" (UID: "e4e6cf39-498b-441b-8c5f-4ab1851f60da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:42.219861 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:42.219829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:42.220037 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.220001    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 12:11:42.220037 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.220023    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 12:11:42.220037 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.220032    2560 projected.go:196] Error preparing data for projected volume kube-api-access-xxkkf for pod openshift-network-diagnostics/network-check-target-7km7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:42.220141 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.220089    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf podName:795dad27-1e8b-43c8-9357-8896d43bc9db nodeName:}" failed. No retries permitted until 2026-09-09 12:11:58.220071331 +0000 UTC m=+34.266196490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxkkf" (UniqueName: "kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf") pod "network-check-target-7km7f" (UID: "795dad27-1e8b-43c8-9357-8896d43bc9db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:42.393612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:42.393536    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:42.393772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:42.393542    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:42.393772 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.393661    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:42.393772 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.393756    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:42.393899 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:42.393544    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:42.393899 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:42.393861    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:44.394779 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:44.394749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:44.395199 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:44.394843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:44.395199 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:44.394883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:44.395199 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:44.394896    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:44.395199 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:44.394956    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:44.395199 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:44.395028    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:45.482556 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.482396    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs" event={"ID":"2fbe76db-b933-4da2-b8df-18ac407d685e","Type":"ContainerStarted","Data":"150cd37f9c118d25ffb1bbb4402d9cc8257fa5a6f5b83a7050f52fa9ed27684b"}
Sep 09 12:11:45.484786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.484507    2560 generic.go:356] "Generic (PLEG): container finished" podID="314da134-39ef-45e0-a464-d1819f7105f5" containerID="6f3bc3b25758866d67eb8983e4e316b5f8dad158f2580eaab96d22eb7ac6fb6a" exitCode=0
Sep 09 12:11:45.484786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.484591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td2j6" event={"ID":"314da134-39ef-45e0-a464-d1819f7105f5","Type":"ContainerDied","Data":"6f3bc3b25758866d67eb8983e4e316b5f8dad158f2580eaab96d22eb7ac6fb6a"}
Sep 09 12:11:45.487445 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.487405    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:11:45.487950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.487791    2560 generic.go:356] "Generic (PLEG): container finished" podID="dbd83909-6943-4c36-b38a-74493ca5b9a7" containerID="13d6aee3a8fc8303bf361107fa5908d01a51e4b0226df1e877e6778c00dd0010" exitCode=1
Sep 09 12:11:45.487950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.487867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"fb19c1134989b20609f2b21531dfe422ec565595a920a44dff89d8bf25d4ca02"}
Sep 09 12:11:45.487950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.487937    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerDied","Data":"13d6aee3a8fc8303bf361107fa5908d01a51e4b0226df1e877e6778c00dd0010"}
Sep 09 12:11:45.488134 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.487990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"b1cfc25581629191eb111f3d5c83e32f4f08f6aea3c78a59b1ef2dc1d8384ed9"}
Sep 09 12:11:45.489957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.489933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-94q8q" event={"ID":"8448f14b-521e-498f-b39c-0f892bc3e915","Type":"ContainerStarted","Data":"ce312cb3079be1e0cce1464e9a066ef916aad0cde22d208b03377567d89a3014"}
Sep 09 12:11:45.492475 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.492451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal" event={"ID":"c16cf88aa13a1d31a699b5b3eff900e5","Type":"ContainerStarted","Data":"e3a023bad0a7b0dbd89763c4d3b29579517804006c274f97b3c8d85f9799b7eb"}
Sep 09 12:11:45.495130 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.495108    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8tj8" event={"ID":"71e54cc6-103c-47d9-b9ac-087705124117","Type":"ContainerStarted","Data":"5ba58c0afdb29a95c969399250559087536572cf7775dba7a29f33b976fd5354"}
Sep 09 12:11:45.496748 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.496694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-phnkk" event={"ID":"1d310f15-0c20-4804-b322-3429f9cf5096","Type":"ContainerStarted","Data":"d21cfc1f579c484b7a576cebb10fc9a055e7cd1e178e36b56bfbd2a77ca91c89"}
Sep 09 12:11:45.498478 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.498452    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t7q7p" event={"ID":"e382006f-225e-4c5e-bfd6-81396a7f4987","Type":"ContainerStarted","Data":"9f597a25eef5ba14063d70e5bbcf45829013b4b0d86ef28ecfdedac100cbbb2c"}
Sep 09 12:11:45.499903 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.499879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcfhg" event={"ID":"2997c875-d03c-4d20-9dc7-6ade576be613","Type":"ContainerStarted","Data":"1d0638d816b537aa19b109604c9475db834ba12f186d7a33c868c2aedf15e835"}
Sep 09 12:11:45.509385 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.509337    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-24.ec2.internal" podStartSLOduration=20.509319318 podStartE2EDuration="20.509319318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:28.466755285 +0000 UTC m=+4.512880467" watchObservedRunningTime="2026-09-09 12:11:45.509319318 +0000 UTC m=+21.555444497"
Sep 09 12:11:45.527794 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.527741    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h8tj8" podStartSLOduration=3.260269512 podStartE2EDuration="21.527718898s" totalImagesPullingTime="18.267449386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:45.527419463 +0000 UTC m=+21.573544640" watchObservedRunningTime="2026-09-09 12:11:45.527718898 +0000 UTC m=+21.573844080"
Sep 09 12:11:45.544940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.544888    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-94q8q" podStartSLOduration=3.261006888 podStartE2EDuration="21.544870796s" totalImagesPullingTime="18.283863908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:45.544481486 +0000 UTC m=+21.590606666" watchObservedRunningTime="2026-09-09 12:11:45.544870796 +0000 UTC m=+21.590995974"
Sep 09 12:11:45.565161 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.565119    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t7q7p" podStartSLOduration=2.997508168 podStartE2EDuration="21.565104639s" totalImagesPullingTime="18.567596471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:45.564846772 +0000 UTC m=+21.610971950" watchObservedRunningTime="2026-09-09 12:11:45.565104639 +0000 UTC m=+21.611229816"
Sep 09 12:11:45.595014 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.594971    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-24.ec2.internal" podStartSLOduration=20.594956064 podStartE2EDuration="20.594956064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:45.578599676 +0000 UTC m=+21.624724854" watchObservedRunningTime="2026-09-09 12:11:45.594956064 +0000 UTC m=+21.641081242"
Sep 09 12:11:45.595152 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.595124    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gcfhg" podStartSLOduration=3.320743523 podStartE2EDuration="21.595116737s" totalImagesPullingTime="18.274373214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:45.594723206 +0000 UTC m=+21.640848384" watchObservedRunningTime="2026-09-09 12:11:45.595116737 +0000 UTC m=+21.641241916"
Sep 09 12:11:45.659601 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.659524    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:45.660045 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.660023    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:45.680390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.680346    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-phnkk" podStartSLOduration=7.534368478 podStartE2EDuration="21.680326149s" totalImagesPullingTime="14.145957671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:45.611556504 +0000 UTC m=+21.657681682" watchObservedRunningTime="2026-09-09 12:11:45.680326149 +0000 UTC m=+21.726451328"
Sep 09 12:11:45.713745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.713714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:45.791785 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:45.791754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:46.393241 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:46.393165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:46.393241 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:46.393209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:46.393443 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:46.393286    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:46.393443 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:46.393333    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:46.393443 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:46.393373    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:46.393443 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:46.393422    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:46.504598 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:46.504580    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:11:46.505155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:46.504967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"888ec0e7c483908b283c4a25032c76764875b32399e6e870ca9c9f72abf831b9"}
Sep 09 12:11:46.505155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:46.505044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"c256547d5b33a894af91f6ebb6f9c18f2a7879842e707bab08c17f4ce16e5e83"}
Sep 09 12:11:46.505155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:46.505072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"337de9bd37f4d0c9034e338cdcc36a55ce70d4063bdd28d35c4d0bfe0af5d07a"}
Sep 09 12:11:46.622529 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:46.622495    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 12:11:47.335769 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.335645    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T12:11:46.622524818Z","UUID":"50b8057a-2aee-480a-b259-d75f5feed19b","Handler":null,"Name":"","Endpoint":""}
Sep 09 12:11:47.337663 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.337638    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 12:11:47.337788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.337677    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 12:11:47.509378 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.509095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zlvzs" event={"ID":"0ba8416f-630f-4a82-b8eb-3ac9aa1620e3","Type":"ContainerStarted","Data":"212bab1d767a1e2f8fbcc11884ab94926738b82d3ed160faf2042424b882cbcc"}
Sep 09 12:11:47.511598 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.511569    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 12:11:47.511598 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.511582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs" event={"ID":"2fbe76db-b933-4da2-b8df-18ac407d685e","Type":"ContainerStarted","Data":"d19ea7d764fceebd8e34b5fe01e2588fff3f39a330a36501a539f807256e73a3"}
Sep 09 12:11:47.526790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.526744    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zlvzs" podStartSLOduration=5.295938513 podStartE2EDuration="23.526728699s" totalImagesPullingTime="18.230790186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:47.526389676 +0000 UTC m=+23.572514855" watchObservedRunningTime="2026-09-09 12:11:47.526728699 +0000 UTC m=+23.572853876"
Sep 09 12:11:47.655603 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.655508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:47.739164 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:47.739135    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:48.394254 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:48.393977    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:48.394254 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:48.394049    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:48.394484 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:48.394052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:48.394484 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:48.394322    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:48.394484 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:48.394420    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:48.394647 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:48.394500    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:48.515787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:48.515749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs" event={"ID":"2fbe76db-b933-4da2-b8df-18ac407d685e","Type":"ContainerStarted","Data":"bf3a83f63ad2a5bea3ba50b307fa81fabb7cc9db6d559c70d01b184373a5c03b"}
Sep 09 12:11:48.518756 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:48.518738    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:11:48.519137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:48.519116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"dd07a8bbf0b66bb812248b2687ae8024ba3aac31169ea308d97e6784b7037d61"}
Sep 09 12:11:48.538210 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:48.538165    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s76bs" podStartSLOduration=3.792201769 podStartE2EDuration="24.538152707s" totalImagesPullingTime="20.745950938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:48.53728803 +0000 UTC m=+24.583413210" watchObservedRunningTime="2026-09-09 12:11:48.538152707 +0000 UTC m=+24.584277883"
Sep 09 12:11:50.393324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:50.393281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:50.393324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:50.393314    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:50.393836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:50.393348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:50.393836 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:50.393440    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:50.393836 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:50.393563    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:50.393836 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:50.393661    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:51.442872 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.442705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:51.443455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.442965    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 12:11:51.443455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.443287    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-94q8q"
Sep 09 12:11:51.528737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.528710    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:11:51.529548 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.529517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"964338f071a06370b4f3979840a01b2f9b2eabb72a8fd96b6d1661d7345d57a7"}
Sep 09 12:11:51.529790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.529770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:51.529910 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.529896    2560 scope.go:117] "RemoveContainer" containerID="13d6aee3a8fc8303bf361107fa5908d01a51e4b0226df1e877e6778c00dd0010"
Sep 09 12:11:51.534642 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.534622    2560 generic.go:356] "Generic (PLEG): container finished" podID="314da134-39ef-45e0-a464-d1819f7105f5" containerID="bb42060107f91edba4006e2fef18b66c0398b2cee6de515cfe385079245c8347" exitCode=0
Sep 09 12:11:51.534735 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.534707    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td2j6" event={"ID":"314da134-39ef-45e0-a464-d1819f7105f5","Type":"ContainerDied","Data":"bb42060107f91edba4006e2fef18b66c0398b2cee6de515cfe385079245c8347"}
Sep 09 12:11:51.545274 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.545238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:51.546324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:51.546272    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:52.393459 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.393427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:52.393558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.393427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:52.393558 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:52.393536    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:52.393646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.393559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:52.393646 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:52.393623    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:52.393738 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:52.393715    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:52.488024 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.487736    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7km7f"]
Sep 09 12:11:52.488908 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.488873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9k524"]
Sep 09 12:11:52.489457 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.489430    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6mbr9"]
Sep 09 12:11:52.503122 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.503099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:52.538768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.538739    2560 generic.go:356] "Generic (PLEG): container finished" podID="314da134-39ef-45e0-a464-d1819f7105f5" containerID="265f4708f282c9531fe03048e3e447d3dc85fc3d73fa7a1e842da4fc4e86490d" exitCode=0
Sep 09 12:11:52.539031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.538813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td2j6" event={"ID":"314da134-39ef-45e0-a464-d1819f7105f5","Type":"ContainerDied","Data":"265f4708f282c9531fe03048e3e447d3dc85fc3d73fa7a1e842da4fc4e86490d"}
Sep 09 12:11:52.542910 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.542893    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:11:52.543271 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.543251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" event={"ID":"dbd83909-6943-4c36-b38a-74493ca5b9a7","Type":"ContainerStarted","Data":"ece0d8e598e275c27d716142294f80e425e75fdd7702ac930c868d469b099114"}
Sep 09 12:11:52.543271 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.543267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:52.543421 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.543259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:52.543421 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.543284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:52.543421 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:52.543391    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:52.543641 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:52.543621    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:52.543950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.543700    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:52.546934 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:52.543691    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:52.546934 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.544176    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:52.559220 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.559200    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:11:52.613130 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.613098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:52.689018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:52.688955    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8" podStartSLOduration=10.399685787 podStartE2EDuration="28.688941095s" totalImagesPullingTime="18.289255308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:11:52.688707151 +0000 UTC m=+28.734832352" watchObservedRunningTime="2026-09-09 12:11:52.688941095 +0000 UTC m=+28.735066273"
Sep 09 12:11:54.394734 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:54.394567    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:54.395114 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:54.394620    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:54.395114 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:54.394805    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:54.395114 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:54.394650    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:54.395114 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:54.394870    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:54.395114 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:54.394967    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:54.550230 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:54.550143    2560 generic.go:356] "Generic (PLEG): container finished" podID="314da134-39ef-45e0-a464-d1819f7105f5" containerID="0bc4b1ad0a77d38a083f699a893b2790a79c12796993cc29431c9b7d377b1c95" exitCode=0
Sep 09 12:11:54.550230 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:54.550207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td2j6" event={"ID":"314da134-39ef-45e0-a464-d1819f7105f5","Type":"ContainerDied","Data":"0bc4b1ad0a77d38a083f699a893b2790a79c12796993cc29431c9b7d377b1c95"}
Sep 09 12:11:55.222000 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:55.221966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:55.345742 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:55.345711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:56.393590 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:56.393497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:56.393590 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:56.393497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:56.394086 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:56.393629    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7km7f" podUID="795dad27-1e8b-43c8-9357-8896d43bc9db"
Sep 09 12:11:56.394086 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:56.393497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:56.394086 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:56.393680    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9k524" podUID="d96a723f-56e9-4550-92c9-abe553637eee"
Sep 09 12:11:56.394086 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:56.393795    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6mbr9" podUID="e4e6cf39-498b-441b-8c5f-4ab1851f60da"
Sep 09 12:11:57.395577 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:57.395546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:57.496419 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:57.496385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:58.131540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.131470    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:58.131540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.131503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:58.131701 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.131617    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:58.131701 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.131670    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret podName:d96a723f-56e9-4550-92c9-abe553637eee nodeName:}" failed. No retries permitted until 2026-09-09 12:12:30.131656356 +0000 UTC m=+66.177781511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret") pod "global-pull-secret-syncer-9k524" (UID: "d96a723f-56e9-4550-92c9-abe553637eee") : object "kube-system"/"original-pull-secret" not registered
Sep 09 12:11:58.131701 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.131616    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:58.131802 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.131735    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs podName:e4e6cf39-498b-441b-8c5f-4ab1851f60da nodeName:}" failed. No retries permitted until 2026-09-09 12:12:30.131723602 +0000 UTC m=+66.177848770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs") pod "network-metrics-daemon-6mbr9" (UID: "e4e6cf39-498b-441b-8c5f-4ab1851f60da") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 12:11:58.232214 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.232182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:58.232391 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.232328    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 12:11:58.232391 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.232343    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 12:11:58.232391 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.232351    2560 projected.go:196] Error preparing data for projected volume kube-api-access-xxkkf for pod openshift-network-diagnostics/network-check-target-7km7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:58.232637 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.232407    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf podName:795dad27-1e8b-43c8-9357-8896d43bc9db nodeName:}" failed. No retries permitted until 2026-09-09 12:12:30.232389834 +0000 UTC m=+66.278514991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxkkf" (UniqueName: "kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf") pod "network-check-target-7km7f" (UID: "795dad27-1e8b-43c8-9357-8896d43bc9db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 12:11:58.278597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.278572    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-24.ec2.internal" event="NodeReady"
Sep 09 12:11:58.278727 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.278692    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 12:11:58.342511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.342481    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qm8dx"]
Sep 09 12:11:58.364595 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.364569    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-42xlx"]
Sep 09 12:11:58.364738 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.364719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.367868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.367353    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 12:11:58.367868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.367639    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 12:11:58.367868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.367850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mksrl\""
Sep 09 12:11:58.376377 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.376356    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-42xlx"]
Sep 09 12:11:58.376477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.376384    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qm8dx"]
Sep 09 12:11:58.376542 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.376476    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-42xlx"
Sep 09 12:11:58.379795 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.379776    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 12:11:58.379904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.379776    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 12:11:58.379904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.379860    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xqhh6\""
Sep 09 12:11:58.380019 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.379967    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 12:11:58.393078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.393051    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:11:58.393190 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.393077    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:11:58.393314 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.393204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:11:58.397235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.397220    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5zgt\""
Sep 09 12:11:58.397581 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.397250    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 12:11:58.397672 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.397600    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6s86q\""
Sep 09 12:11:58.397737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.397667    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 12:11:58.398348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.398228    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 12:11:58.398348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.398247    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 12:11:58.420659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.420632    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:58.433165 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.433140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2cb5506-1e6f-44b3-bdac-0d615d255d22-tmp-dir\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.433278 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.433175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2cb5506-1e6f-44b3-bdac-0d615d255d22-config-volume\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.433278 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.433222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnpsc\" (UniqueName: \"kubernetes.io/projected/e2cb5506-1e6f-44b3-bdac-0d615d255d22-kube-api-access-lnpsc\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.433389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.433282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.514726 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.514672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:58.534612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.534582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2cb5506-1e6f-44b3-bdac-0d615d255d22-tmp-dir\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.534774 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.534621    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2cb5506-1e6f-44b3-bdac-0d615d255d22-config-volume\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.534774 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.534652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba33ef51-b139-4cad-bc19-58d536f4bfe1-cert\") pod \"ingress-canary-42xlx\" (UID: \"ba33ef51-b139-4cad-bc19-58d536f4bfe1\") " pod="openshift-ingress-canary/ingress-canary-42xlx"
Sep 09 12:11:58.534774 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.534692    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxw7q\" (UniqueName: \"kubernetes.io/projected/ba33ef51-b139-4cad-bc19-58d536f4bfe1-kube-api-access-sxw7q\") pod \"ingress-canary-42xlx\" (UID: \"ba33ef51-b139-4cad-bc19-58d536f4bfe1\") " pod="openshift-ingress-canary/ingress-canary-42xlx"
Sep 09 12:11:58.534774 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.534742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnpsc\" (UniqueName: \"kubernetes.io/projected/e2cb5506-1e6f-44b3-bdac-0d615d255d22-kube-api-access-lnpsc\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.534956 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.534790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.534956 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.534938    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 12:11:58.535049 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.534989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2cb5506-1e6f-44b3-bdac-0d615d255d22-tmp-dir\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.535049 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.535020    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls podName:e2cb5506-1e6f-44b3-bdac-0d615d255d22 nodeName:}" failed. No retries permitted until 2026-09-09 12:11:59.034998809 +0000 UTC m=+35.081123968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls") pod "dns-default-qm8dx" (UID: "e2cb5506-1e6f-44b3-bdac-0d615d255d22") : secret "dns-default-metrics-tls" not found
Sep 09 12:11:58.535268 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.535247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2cb5506-1e6f-44b3-bdac-0d615d255d22-config-volume\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.551608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.551584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnpsc\" (UniqueName: \"kubernetes.io/projected/e2cb5506-1e6f-44b3-bdac-0d615d255d22-kube-api-access-lnpsc\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:58.628445 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.628393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:58.635474 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.635425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba33ef51-b139-4cad-bc19-58d536f4bfe1-cert\") pod \"ingress-canary-42xlx\" (UID: \"ba33ef51-b139-4cad-bc19-58d536f4bfe1\") " pod="openshift-ingress-canary/ingress-canary-42xlx"
Sep 09 12:11:58.635474 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.635462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxw7q\" (UniqueName: \"kubernetes.io/projected/ba33ef51-b139-4cad-bc19-58d536f4bfe1-kube-api-access-sxw7q\") pod \"ingress-canary-42xlx\" (UID: \"ba33ef51-b139-4cad-bc19-58d536f4bfe1\") " pod="openshift-ingress-canary/ingress-canary-42xlx"
Sep 09 12:11:58.637811 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.637786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba33ef51-b139-4cad-bc19-58d536f4bfe1-cert\") pod \"ingress-canary-42xlx\" (UID: \"ba33ef51-b139-4cad-bc19-58d536f4bfe1\") " pod="openshift-ingress-canary/ingress-canary-42xlx"
Sep 09 12:11:58.646124 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.646101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxw7q\" (UniqueName: \"kubernetes.io/projected/ba33ef51-b139-4cad-bc19-58d536f4bfe1-kube-api-access-sxw7q\") pod \"ingress-canary-42xlx\" (UID: \"ba33ef51-b139-4cad-bc19-58d536f4bfe1\") " pod="openshift-ingress-canary/ingress-canary-42xlx"
Sep 09 12:11:58.680087 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.680060    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vwngl"]
Sep 09 12:11:58.685281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.685261    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-42xlx"
Sep 09 12:11:58.690692 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.690677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.693643 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.693624    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lrqz2\""
Sep 09 12:11:58.693707 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.693632    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 12:11:58.693829 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.693816    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 12:11:58.694080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.694064    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 12:11:58.694173 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.694063    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 12:11:58.696331 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.696311    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vwngl"]
Sep 09 12:11:58.718417 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.718387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:58.837571 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.837534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-crio-socket\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.837748 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.837577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.837748 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.837651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.837748 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.837698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-data-volume\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.837748 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.837733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4kxl\" (UniqueName: \"kubernetes.io/projected/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-api-access-h4kxl\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.938392 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.938311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-crio-socket\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.938392 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.938359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.938595 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.938399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.938595 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.938431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-data-volume\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.938595 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.938519    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 12:11:58.938595 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.938545    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 12:11:58.938595 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.938545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-crio-socket\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.938595 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.938588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4kxl\" (UniqueName: \"kubernetes.io/projected/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-api-access-h4kxl\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.938595 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.938600    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:11:59.43857944 +0000 UTC m=+35.484704599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : configmap "kube-rbac-proxy" not found
Sep 09 12:11:58.938892 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:58.938654    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:11:59.438616521 +0000 UTC m=+35.484741677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : secret "insights-runtime-extractor-tls" not found
Sep 09 12:11:58.938892 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.938732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-data-volume\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:58.950215 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:58.950190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4kxl\" (UniqueName: \"kubernetes.io/projected/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-api-access-h4kxl\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:59.039646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.039610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:11:59.039811 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:59.039784    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 12:11:59.039887 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:59.039874    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls podName:e2cb5506-1e6f-44b3-bdac-0d615d255d22 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:00.039852863 +0000 UTC m=+36.085978035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls") pod "dns-default-qm8dx" (UID: "e2cb5506-1e6f-44b3-bdac-0d615d255d22") : secret "dns-default-metrics-tls" not found
Sep 09 12:11:59.401116 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.401043    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts"]
Sep 09 12:11:59.435169 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.435136    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts"]
Sep 09 12:11:59.435348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.435316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts"
Sep 09 12:11:59.440452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.440411    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 12:11:59.441060 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.441039    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 12:11:59.441172 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.441120    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fhhlr\""
Sep 09 12:11:59.442363 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.442342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:59.442485 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:59.442462    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 12:11:59.442597 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:59.442529    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:00.442508757 +0000 UTC m=+36.488633918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : configmap "kube-rbac-proxy" not found
Sep 09 12:11:59.442597 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:59.442546    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 12:11:59.442597 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:11:59.442595    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:00.44257973 +0000 UTC m=+36.488704919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : secret "insights-runtime-extractor-tls" not found
Sep 09 12:11:59.442788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.442462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:11:59.455146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.455122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:59.543952 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.543912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8fft\" (UniqueName: \"kubernetes.io/projected/0e054970-a99c-47ff-aad2-576a50e11788-kube-api-access-k8fft\") pod \"migrator-fdbb8fdff-tw8ts\" (UID: \"0e054970-a99c-47ff-aad2-576a50e11788\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts"
Sep 09 12:11:59.551938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.551901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:11:59.644951 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.644913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fft\" (UniqueName: \"kubernetes.io/projected/0e054970-a99c-47ff-aad2-576a50e11788-kube-api-access-k8fft\") pod \"migrator-fdbb8fdff-tw8ts\" (UID: \"0e054970-a99c-47ff-aad2-576a50e11788\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts"
Sep 09 12:11:59.655597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.655532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8fft\" (UniqueName: \"kubernetes.io/projected/0e054970-a99c-47ff-aad2-576a50e11788-kube-api-access-k8fft\") pod \"migrator-fdbb8fdff-tw8ts\" (UID: \"0e054970-a99c-47ff-aad2-576a50e11788\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts"
Sep 09 12:11:59.746339 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:11:59.746306    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts"
Sep 09 12:12:00.048199 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.048116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:00.048362 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:00.048272    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 12:12:00.048362 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:00.048347    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls podName:e2cb5506-1e6f-44b3-bdac-0d615d255d22 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:02.048331042 +0000 UTC m=+38.094456213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls") pod "dns-default-qm8dx" (UID: "e2cb5506-1e6f-44b3-bdac-0d615d255d22") : secret "dns-default-metrics-tls" not found
Sep 09 12:12:00.296272 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.295108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:00.394954 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.394922    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:00.451653 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.451620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:00.452207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.451730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:00.452207 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:00.451737    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 12:12:00.452207 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:00.451844    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:02.451826128 +0000 UTC m=+38.497951286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : configmap "kube-rbac-proxy" not found
Sep 09 12:12:00.452207 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:00.451861    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 12:12:00.452207 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:00.451909    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:02.451895868 +0000 UTC m=+38.498021024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : secret "insights-runtime-extractor-tls" not found
Sep 09 12:12:00.495521 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.495488    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:00.554041 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.554019    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts"]
Sep 09 12:12:00.556924 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.556897    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-42xlx"]
Sep 09 12:12:00.557525 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:00.557490    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e054970_a99c_47ff_aad2_576a50e11788.slice/crio-ec068df56cf4a246f91b3ed56a03f946812f72fd172c80ff1527240fc6c3773b WatchSource:0}: Error finding container ec068df56cf4a246f91b3ed56a03f946812f72fd172c80ff1527240fc6c3773b: Status 404 returned error can't find the container with id ec068df56cf4a246f91b3ed56a03f946812f72fd172c80ff1527240fc6c3773b
Sep 09 12:12:00.559439 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:00.559400    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba33ef51_b139_4cad_bc19_58d536f4bfe1.slice/crio-04a6317447e84bd50e7ce63c5af9e80de21455f228ebfe490750761c8cc1e8e0 WatchSource:0}: Error finding container 04a6317447e84bd50e7ce63c5af9e80de21455f228ebfe490750761c8cc1e8e0: Status 404 returned error can't find the container with id 04a6317447e84bd50e7ce63c5af9e80de21455f228ebfe490750761c8cc1e8e0
Sep 09 12:12:00.565630 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.565563    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-42xlx" event={"ID":"ba33ef51-b139-4cad-bc19-58d536f4bfe1","Type":"ContainerStarted","Data":"04a6317447e84bd50e7ce63c5af9e80de21455f228ebfe490750761c8cc1e8e0"}
Sep 09 12:12:00.566949 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.566917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts" event={"ID":"0e054970-a99c-47ff-aad2-576a50e11788","Type":"ContainerStarted","Data":"ec068df56cf4a246f91b3ed56a03f946812f72fd172c80ff1527240fc6c3773b"}
Sep 09 12:12:00.650367 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:00.650348    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcfhg_2997c875-d03c-4d20-9dc7-6ade576be613/dns-node-resolver/0.log"
Sep 09 12:12:01.573043 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:01.573008    2560 generic.go:356] "Generic (PLEG): container finished" podID="314da134-39ef-45e0-a464-d1819f7105f5" containerID="c9c8bf9ad1c26f49f0702e8784d0b51e1cc3f672ede80914e2871e9971c6a813" exitCode=0
Sep 09 12:12:01.573795 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:01.573061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td2j6" event={"ID":"314da134-39ef-45e0-a464-d1819f7105f5","Type":"ContainerDied","Data":"c9c8bf9ad1c26f49f0702e8784d0b51e1cc3f672ede80914e2871e9971c6a813"}
Sep 09 12:12:01.637979 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:01.637906    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-phnkk_1d310f15-0c20-4804-b322-3429f9cf5096/node-ca/0.log"
Sep 09 12:12:02.066139 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.066108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:02.066278 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:02.066252    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 12:12:02.066338 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:02.066326    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls podName:e2cb5506-1e6f-44b3-bdac-0d615d255d22 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:06.066313179 +0000 UTC m=+42.112438338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls") pod "dns-default-qm8dx" (UID: "e2cb5506-1e6f-44b3-bdac-0d615d255d22") : secret "dns-default-metrics-tls" not found
Sep 09 12:12:02.212477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.212402    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t"]
Sep 09 12:12:02.230613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.230586    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t"]
Sep 09 12:12:02.230741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.230692    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t"
Sep 09 12:12:02.233425 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.233381    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 12:12:02.233583 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.233566    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ml7sn\""
Sep 09 12:12:02.233653 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.233582    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 12:12:02.236842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.236817    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"]
Sep 09 12:12:02.252823 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.252801    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"]
Sep 09 12:12:02.252920 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.252888    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.255469 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.255451    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 12:12:02.255806 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.255788    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 12:12:02.255888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.255797    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 12:12:02.255888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.255827    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 12:12:02.255888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.255878    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t4jns\""
Sep 09 12:12:02.368878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.368842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c720f6f-269a-4d99-b67f-354d268eeabb-serving-cert\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.369019 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.368891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c720f6f-269a-4d99-b67f-354d268eeabb-config\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.369069 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.369012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2hq\" (UniqueName: \"kubernetes.io/projected/887ed2a1-d0f5-4fb1-bacb-392be83a98fb-kube-api-access-cc2hq\") pod \"volume-data-source-validator-695c895bd6-bfb6t\" (UID: \"887ed2a1-d0f5-4fb1-bacb-392be83a98fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t"
Sep 09 12:12:02.369069 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.369061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h996f\" (UniqueName: \"kubernetes.io/projected/6c720f6f-269a-4d99-b67f-354d268eeabb-kube-api-access-h996f\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.469779 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.469704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c720f6f-269a-4d99-b67f-354d268eeabb-config\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.469932 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.469791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:02.469932 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.469838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2hq\" (UniqueName: \"kubernetes.io/projected/887ed2a1-d0f5-4fb1-bacb-392be83a98fb-kube-api-access-cc2hq\") pod \"volume-data-source-validator-695c895bd6-bfb6t\" (UID: \"887ed2a1-d0f5-4fb1-bacb-392be83a98fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t"
Sep 09 12:12:02.469932 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.469865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:02.469932 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.469905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h996f\" (UniqueName: \"kubernetes.io/projected/6c720f6f-269a-4d99-b67f-354d268eeabb-kube-api-access-h996f\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.469932 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.469929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c720f6f-269a-4d99-b67f-354d268eeabb-serving-cert\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.470178 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:02.469947    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 12:12:02.470178 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:02.470014    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 12:12:02.470178 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:02.470028    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:06.470006998 +0000 UTC m=+42.516132155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : secret "insights-runtime-extractor-tls" not found
Sep 09 12:12:02.470178 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:02.470083    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:06.470066531 +0000 UTC m=+42.516191716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : configmap "kube-rbac-proxy" not found
Sep 09 12:12:02.470369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.470348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c720f6f-269a-4d99-b67f-354d268eeabb-config\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.473149 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.473128    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c720f6f-269a-4d99-b67f-354d268eeabb-serving-cert\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.479626 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.479606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2hq\" (UniqueName: \"kubernetes.io/projected/887ed2a1-d0f5-4fb1-bacb-392be83a98fb-kube-api-access-cc2hq\") pod \"volume-data-source-validator-695c895bd6-bfb6t\" (UID: \"887ed2a1-d0f5-4fb1-bacb-392be83a98fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t"
Sep 09 12:12:02.480090 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.480061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h996f\" (UniqueName: \"kubernetes.io/projected/6c720f6f-269a-4d99-b67f-354d268eeabb-kube-api-access-h996f\") pod \"service-ca-operator-859f94c4b-9htlw\" (UID: \"6c720f6f-269a-4d99-b67f-354d268eeabb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.538985 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.538957    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t"
Sep 09 12:12:02.562068 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.561968    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"
Sep 09 12:12:02.579109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.579086    2560 generic.go:356] "Generic (PLEG): container finished" podID="314da134-39ef-45e0-a464-d1819f7105f5" containerID="e6a5a67dcb7dd6bd2d69c74633afd057670840f7a051e28f14285142832c89b9" exitCode=0
Sep 09 12:12:02.579500 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.579132    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td2j6" event={"ID":"314da134-39ef-45e0-a464-d1819f7105f5","Type":"ContainerDied","Data":"e6a5a67dcb7dd6bd2d69c74633afd057670840f7a051e28f14285142832c89b9"}
Sep 09 12:12:02.856789 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.856665    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t"]
Sep 09 12:12:02.860399 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:02.860362    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887ed2a1_d0f5_4fb1_bacb_392be83a98fb.slice/crio-d3aabe7bdb583724944ea04c2fe2036bd399a1a2c089bf2e6411a7198df42b64 WatchSource:0}: Error finding container d3aabe7bdb583724944ea04c2fe2036bd399a1a2c089bf2e6411a7198df42b64: Status 404 returned error can't find the container with id d3aabe7bdb583724944ea04c2fe2036bd399a1a2c089bf2e6411a7198df42b64
Sep 09 12:12:02.892885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:02.892854    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw"]
Sep 09 12:12:02.896745 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:02.896718    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c720f6f_269a_4d99_b67f_354d268eeabb.slice/crio-6b9672887c3bac932ef002ddc902fbfb0561d9e85be6cab467e416fbafb82ffe WatchSource:0}: Error finding container 6b9672887c3bac932ef002ddc902fbfb0561d9e85be6cab467e416fbafb82ffe: Status 404 returned error can't find the container with id 6b9672887c3bac932ef002ddc902fbfb0561d9e85be6cab467e416fbafb82ffe
Sep 09 12:12:03.585560 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.584733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts" event={"ID":"0e054970-a99c-47ff-aad2-576a50e11788","Type":"ContainerStarted","Data":"499d982486d54295d4dbb376eae31a57eb92a698bc8828835701401461151cf5"}
Sep 09 12:12:03.585560 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.584798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts" event={"ID":"0e054970-a99c-47ff-aad2-576a50e11788","Type":"ContainerStarted","Data":"805c3147b4f588a1206e267f4c609bf337bc374123405e4e13281264097df50c"}
Sep 09 12:12:03.587113 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.587085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw" event={"ID":"6c720f6f-269a-4d99-b67f-354d268eeabb","Type":"ContainerStarted","Data":"6b9672887c3bac932ef002ddc902fbfb0561d9e85be6cab467e416fbafb82ffe"}
Sep 09 12:12:03.588571 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.588544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t" event={"ID":"887ed2a1-d0f5-4fb1-bacb-392be83a98fb","Type":"ContainerStarted","Data":"d3aabe7bdb583724944ea04c2fe2036bd399a1a2c089bf2e6411a7198df42b64"}
Sep 09 12:12:03.593246 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.593222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td2j6" event={"ID":"314da134-39ef-45e0-a464-d1819f7105f5","Type":"ContainerStarted","Data":"453d1fd7779f297e5efbdfdc9b05061d7cb5dab190a451a8b862d884d1722203"}
Sep 09 12:12:03.603390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.603064    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-tw8ts" podStartSLOduration=2.663304013 podStartE2EDuration="4.603047937s" totalImagesPullingTime="1.939743924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:03.602829496 +0000 UTC m=+39.648954683" watchObservedRunningTime="2026-09-09 12:12:03.603047937 +0000 UTC m=+39.649173115"
Sep 09 12:12:03.627390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.627341    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-td2j6" podStartSLOduration=7.847429443 podStartE2EDuration="39.627328229s" totalImagesPullingTime="31.779898786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:03.625623269 +0000 UTC m=+39.671748452" watchObservedRunningTime="2026-09-09 12:12:03.627328229 +0000 UTC m=+39.673453407"
Sep 09 12:12:03.754763 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.754682    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:03.814697 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.814613    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:03.956823 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:03.956537    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:06.101772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.101734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:06.102095 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:06.101913    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 12:12:06.102095 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:06.101989    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls podName:e2cb5506-1e6f-44b3-bdac-0d615d255d22 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:14.101969839 +0000 UTC m=+50.148094999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls") pod "dns-default-qm8dx" (UID: "e2cb5506-1e6f-44b3-bdac-0d615d255d22") : secret "dns-default-metrics-tls" not found
Sep 09 12:12:06.505544 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.505507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:06.505707 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.505585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:06.505707 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:06.505653    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 12:12:06.505707 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:06.505677    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 12:12:06.505852 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:06.505732    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:14.505712412 +0000 UTC m=+50.551837582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : configmap "kube-rbac-proxy" not found
Sep 09 12:12:06.505852 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:06.505753    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:14.505744313 +0000 UTC m=+50.551869501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : secret "insights-runtime-extractor-tls" not found
Sep 09 12:12:06.602969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.602935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-42xlx" event={"ID":"ba33ef51-b139-4cad-bc19-58d536f4bfe1","Type":"ContainerStarted","Data":"82456a1fedb37d1e3a25ff37d49537029338c82b71eb7cda57182ad8feba0627"}
Sep 09 12:12:06.604416 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.604393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw" event={"ID":"6c720f6f-269a-4d99-b67f-354d268eeabb","Type":"ContainerStarted","Data":"34c5326fae769eb1b807591a68909b357a3774ae948b4b15a010e4b2686bd481"}
Sep 09 12:12:06.605912 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.605892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t" event={"ID":"887ed2a1-d0f5-4fb1-bacb-392be83a98fb","Type":"ContainerStarted","Data":"4996a642f28571cd21f678c2548e5efa2c3444103ff04fab3bcc058b44caaae0"}
Sep 09 12:12:06.620917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.620877    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-42xlx" podStartSLOduration=3.251208502 podStartE2EDuration="8.620862265s" totalImagesPullingTime="5.369653763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:06.620341112 +0000 UTC m=+42.666466292" watchObservedRunningTime="2026-09-09 12:12:06.620862265 +0000 UTC m=+42.666987443"
Sep 09 12:12:06.635508 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.635458    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bfb6t" podStartSLOduration=1.56672514 podStartE2EDuration="4.63544036s" totalImagesPullingTime="3.06871522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:06.634837285 +0000 UTC m=+42.680962463" watchObservedRunningTime="2026-09-09 12:12:06.63544036 +0000 UTC m=+42.681565539"
Sep 09 12:12:06.650846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.650801    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw" podStartSLOduration=1.61126144 podStartE2EDuration="4.650784224s" totalImagesPullingTime="3.039522784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:06.650408759 +0000 UTC m=+42.696533936" watchObservedRunningTime="2026-09-09 12:12:06.650784224 +0000 UTC m=+42.696909404"
Sep 09 12:12:06.754991 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:06.754955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:07.072523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.072489    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:07.175250 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.175218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:07.514393 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.514309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:07.555884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.555853    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-rxp86"]
Sep 09 12:12:07.576779 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.576756    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-rxp86"]
Sep 09 12:12:07.576909 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.576838    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-rxp86"
Sep 09 12:12:07.579322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.579303    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-69wfg\""
Sep 09 12:12:07.597858 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.597833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:07.715865 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.715822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q74v\" (UniqueName: \"kubernetes.io/projected/29c5b6cd-b109-4545-a019-219afca837bd-kube-api-access-2q74v\") pod \"network-check-source-685456655f-rxp86\" (UID: \"29c5b6cd-b109-4545-a019-219afca837bd\") " pod="openshift-network-diagnostics/network-check-source-685456655f-rxp86"
Sep 09 12:12:07.816345 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.816310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q74v\" (UniqueName: \"kubernetes.io/projected/29c5b6cd-b109-4545-a019-219afca837bd-kube-api-access-2q74v\") pod \"network-check-source-685456655f-rxp86\" (UID: \"29c5b6cd-b109-4545-a019-219afca837bd\") " pod="openshift-network-diagnostics/network-check-source-685456655f-rxp86"
Sep 09 12:12:07.828099 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.828071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q74v\" (UniqueName: \"kubernetes.io/projected/29c5b6cd-b109-4545-a019-219afca837bd-kube-api-access-2q74v\") pod \"network-check-source-685456655f-rxp86\" (UID: \"29c5b6cd-b109-4545-a019-219afca837bd\") " pod="openshift-network-diagnostics/network-check-source-685456655f-rxp86"
Sep 09 12:12:07.884832 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:07.884802    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-rxp86"
Sep 09 12:12:08.227306 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.227269    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-rxp86"]
Sep 09 12:12:08.229333 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:08.229288    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c5b6cd_b109_4545_a019_219afca837bd.slice/crio-3fe78409e0e66192a063b694fd5bb1c838f0a621f9c89eb94240b47420c04a5d WatchSource:0}: Error finding container 3fe78409e0e66192a063b694fd5bb1c838f0a621f9c89eb94240b47420c04a5d: Status 404 returned error can't find the container with id 3fe78409e0e66192a063b694fd5bb1c838f0a621f9c89eb94240b47420c04a5d
Sep 09 12:12:08.336557 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.336519    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7488c4545b-v6b58"]
Sep 09 12:12:08.364343 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.364308    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7488c4545b-v6b58"]
Sep 09 12:12:08.364494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.364382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.370568 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.370542    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 12:12:08.370718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.370666    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bkd5d\""
Sep 09 12:12:08.370718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.370681    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 12:12:08.371868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.371848    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 12:12:08.374333 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.374315    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 12:12:08.521782 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.521697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-bound-sa-token\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.521782 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.521751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/072bc001-0e4c-4000-bafc-0d50ad6b5065-ca-trust-extracted\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.521969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.521783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-image-registry-private-configuration\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.521969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.521807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-certificates\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.521969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.521839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j29mq\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-kube-api-access-j29mq\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.521969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.521944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-trusted-ca\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.522093 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.521985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-installation-pull-secrets\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.522093 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.522049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.612760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.612733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-rxp86" event={"ID":"29c5b6cd-b109-4545-a019-219afca837bd","Type":"ContainerStarted","Data":"3fe78409e0e66192a063b694fd5bb1c838f0a621f9c89eb94240b47420c04a5d"}
Sep 09 12:12:08.623126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j29mq\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-kube-api-access-j29mq\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.623253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-trusted-ca\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.623253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-installation-pull-secrets\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.623253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.623253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-bound-sa-token\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.623845 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/072bc001-0e4c-4000-bafc-0d50ad6b5065-ca-trust-extracted\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.623845 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-image-registry-private-configuration\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.623845 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-certificates\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.623845 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:08.623378    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 12:12:08.623845 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:08.623395    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7488c4545b-v6b58: secret "image-registry-tls" not found
Sep 09 12:12:08.623845 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:08.623451    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls podName:072bc001-0e4c-4000-bafc-0d50ad6b5065 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:09.123431859 +0000 UTC m=+45.169557030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls") pod "image-registry-7488c4545b-v6b58" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065") : secret "image-registry-tls" not found
Sep 09 12:12:08.623845 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/072bc001-0e4c-4000-bafc-0d50ad6b5065-ca-trust-extracted\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.624100 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.623953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-certificates\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.624162 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.624145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-trusted-ca\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.625737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.625717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-installation-pull-secrets\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.625819 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.625752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-image-registry-private-configuration\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.634632 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.634603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-bound-sa-token\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:08.634741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:08.634724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j29mq\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-kube-api-access-j29mq\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:09.033610 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:09.033572    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:09.105820 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:09.105765    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:09.127811 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:09.127782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:09.127960 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:09.127944    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 12:12:09.128022 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:09.127966    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7488c4545b-v6b58: secret "image-registry-tls" not found
Sep 09 12:12:09.128073 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:09.128034    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls podName:072bc001-0e4c-4000-bafc-0d50ad6b5065 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:10.128010571 +0000 UTC m=+46.174135741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls") pod "image-registry-7488c4545b-v6b58" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065") : secret "image-registry-tls" not found
Sep 09 12:12:10.134680 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:10.134639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:10.135146 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:10.134846    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 12:12:10.135146 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:10.134870    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7488c4545b-v6b58: secret "image-registry-tls" not found
Sep 09 12:12:10.135146 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:10.134942    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls podName:072bc001-0e4c-4000-bafc-0d50ad6b5065 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:12.134921154 +0000 UTC m=+48.181046321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls") pod "image-registry-7488c4545b-v6b58" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065") : secret "image-registry-tls" not found
Sep 09 12:12:10.660151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:10.660120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:10.759134 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:10.759092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:11.513256 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:11.513220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:12.152094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:12.152059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:12.152281 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:12.152219    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 12:12:12.152281 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:12.152235    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7488c4545b-v6b58: secret "image-registry-tls" not found
Sep 09 12:12:12.152446 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:12.152321    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls podName:072bc001-0e4c-4000-bafc-0d50ad6b5065 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:16.152287468 +0000 UTC m=+52.198412630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls") pod "image-registry-7488c4545b-v6b58" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065") : secret "image-registry-tls" not found
Sep 09 12:12:13.430874 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:13.430806    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:13.631579 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:13.631548    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-rxp86" event={"ID":"29c5b6cd-b109-4545-a019-219afca837bd","Type":"ContainerStarted","Data":"5f81de83a9bb2b75440977b8d7adfdada3d2fe67e3096b316fa2ab3452ec262d"}
Sep 09 12:12:13.648840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:13.648782    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-rxp86" podStartSLOduration=1.6644651019999999 podStartE2EDuration="6.648761904s" totalImagesPullingTime="4.984296802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:13.648119219 +0000 UTC m=+49.694244397" watchObservedRunningTime="2026-09-09 12:12:13.648761904 +0000 UTC m=+49.694887074"
Sep 09 12:12:13.890398 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:13.890323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:13.986582 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:13.986545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:14.166324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:14.166230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:14.166475 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:14.166433    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 12:12:14.166519 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:14.166512    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls podName:e2cb5506-1e6f-44b3-bdac-0d615d255d22 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:30.166491227 +0000 UTC m=+66.212616385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls") pod "dns-default-qm8dx" (UID: "e2cb5506-1e6f-44b3-bdac-0d615d255d22") : secret "dns-default-metrics-tls" not found
Sep 09 12:12:14.569998 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:14.569960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:14.570387 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:14.570024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:14.570387 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:14.570117    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 12:12:14.570387 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:14.570211    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls podName:1ed2dc37-8e5a-401f-aefe-26f57c01e9ce nodeName:}" failed. No retries permitted until 2026-09-09 12:12:30.57019149 +0000 UTC m=+66.616316663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwngl" (UID: "1ed2dc37-8e5a-401f-aefe-26f57c01e9ce") : secret "insights-runtime-extractor-tls" not found
Sep 09 12:12:14.570608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:14.570590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:14.604453 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:14.604425    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:15.199461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:15.199431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:15.397975 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:15.397946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:15.800129 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:15.800099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:16.011885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:16.011855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:16.182143 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:16.182111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:16.182322 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:16.182234    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 12:12:16.182322 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:16.182247    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7488c4545b-v6b58: secret "image-registry-tls" not found
Sep 09 12:12:16.182322 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:12:16.182315    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls podName:072bc001-0e4c-4000-bafc-0d50ad6b5065 nodeName:}" failed. No retries permitted until 2026-09-09 12:12:24.182283428 +0000 UTC m=+60.228408598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls") pod "image-registry-7488c4545b-v6b58" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065") : secret "image-registry-tls" not found
Sep 09 12:12:16.399971 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:16.399935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:17.001724 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:17.001688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:17.508779 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:17.508730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:17.610269 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:17.610235    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:17.832637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:17.832600    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:18.209839 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:18.209769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:18.306527 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:18.306498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:18.446832 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:18.446802    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:18.999683 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:18.999646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:19.412780 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:19.412747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:19.811540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:19.811508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:19.879562 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:19.879525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:20.204319 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:20.204230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:20.397786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:20.397747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:20.821955 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:20.821917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:21.199129 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:21.199038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:21.997014 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:21.996978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:22.428944 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:22.428906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:22.611946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:22.611913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:23.068235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:23.068196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:23.164189 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:23.164147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:23.804253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:23.804197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:24.003917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.003881    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:24.205866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.205782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:24.240269 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.240234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:24.242519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.242499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"image-registry-7488c4545b-v6b58\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") " pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:24.275607 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.275586    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bkd5d\""
Sep 09 12:12:24.283621 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.283601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:24.557914 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.557816    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7488c4545b-v6b58"]
Sep 09 12:12:24.560448 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:24.560416    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072bc001_0e4c_4000_bafc_0d50ad6b5065.slice/crio-00ea80323f112b33f959bbd092b05e829f9f188f5823e7b2e03ed53b09ddb917 WatchSource:0}: Error finding container 00ea80323f112b33f959bbd092b05e829f9f188f5823e7b2e03ed53b09ddb917: Status 404 returned error can't find the container with id 00ea80323f112b33f959bbd092b05e829f9f188f5823e7b2e03ed53b09ddb917
Sep 09 12:12:24.561001 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.560978    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44tg8"
Sep 09 12:12:24.663281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.663251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7488c4545b-v6b58" event={"ID":"072bc001-0e4c-4000-bafc-0d50ad6b5065","Type":"ContainerStarted","Data":"0c0b408855f351d8d94518b26723f3324c7cb782555d1b96b45260ef6ee01503"}
Sep 09 12:12:24.663424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.663311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7488c4545b-v6b58" event={"ID":"072bc001-0e4c-4000-bafc-0d50ad6b5065","Type":"ContainerStarted","Data":"00ea80323f112b33f959bbd092b05e829f9f188f5823e7b2e03ed53b09ddb917"}
Sep 09 12:12:24.663424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.663379    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:24.684891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:24.684849    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7488c4545b-v6b58" podStartSLOduration=16.684835954 podStartE2EDuration="16.684835954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:24.68361917 +0000 UTC m=+60.729744347" watchObservedRunningTime="2026-09-09 12:12:24.684835954 +0000 UTC m=+60.730961131"
Sep 09 12:12:25.443480 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:25.443417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:25.523582 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:25.523549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:26.689616 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:26.689585    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:26.784744 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:26.784717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:27.202793 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:27.202762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:27.321438 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:27.321400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:27.423747 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:27.423711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:27.521622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:27.521545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:27.637764 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:27.637727    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:27.789203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:27.789109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:27.861956 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:27.861927    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:27.949860 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:27.949825    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:28.378673 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:28.378641    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:28.479026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:28.478987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:28.591705 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:28.591666    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:28.805007 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:28.804976    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:30.183683 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.183634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:30.183683 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.183683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:12:30.184142 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.183704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:12:30.189812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.185897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2cb5506-1e6f-44b3-bdac-0d615d255d22-metrics-tls\") pod \"dns-default-qm8dx\" (UID: \"e2cb5506-1e6f-44b3-bdac-0d615d255d22\") " pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:30.190085 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.190065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 12:12:30.190911 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.190896    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 12:12:30.195898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.195875    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e6cf39-498b-441b-8c5f-4ab1851f60da-metrics-certs\") pod \"network-metrics-daemon-6mbr9\" (UID: \"e4e6cf39-498b-441b-8c5f-4ab1851f60da\") " pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:12:30.195988 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.195882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d96a723f-56e9-4550-92c9-abe553637eee-original-pull-secret\") pod \"global-pull-secret-syncer-9k524\" (UID: \"d96a723f-56e9-4550-92c9-abe553637eee\") " pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:12:30.201896 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.201878    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9k524"
Sep 09 12:12:30.215408 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.215388    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6s86q\""
Sep 09 12:12:30.223548 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.223532    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6mbr9"
Sep 09 12:12:30.285057 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.284971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:12:30.287463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.287439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkkf\" (UniqueName: \"kubernetes.io/projected/795dad27-1e8b-43c8-9357-8896d43bc9db-kube-api-access-xxkkf\") pod \"network-check-target-7km7f\" (UID: \"795dad27-1e8b-43c8-9357-8896d43bc9db\") " pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:12:30.310925 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.310891    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"]
Sep 09 12:12:30.313592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.313572    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.315831 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.315803    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 12:12:30.316151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.316127    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 12:12:30.316255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.316204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 12:12:30.316255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.316240    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 12:12:30.337339 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.337316    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"]
Sep 09 12:12:30.354669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.354642    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7488c4545b-v6b58"]
Sep 09 12:12:30.355682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.355660    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-f5k6k"]
Sep 09 12:12:30.357561 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.357541    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-f5k6k"
Sep 09 12:12:30.359689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.359671    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 12:12:30.359777 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.359677    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nb8jj\""
Sep 09 12:12:30.359943 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.359930    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 12:12:30.369481 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.369459    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6556d8945f-r947j"]
Sep 09 12:12:30.371040 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.371023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.378052 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.378034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-f5k6k"]
Sep 09 12:12:30.386012 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.385993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-klusterlet-config\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.386104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.386034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gszrt\" (UniqueName: \"kubernetes.io/projected/26ecc0f2-68a1-4a42-8828-25be652520d4-kube-api-access-gszrt\") pod \"downloads-85d98c998f-f5k6k\" (UID: \"26ecc0f2-68a1-4a42-8828-25be652520d4\") " pod="openshift-console/downloads-85d98c998f-f5k6k"
Sep 09 12:12:30.386104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.386050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtckp\" (UniqueName: \"kubernetes.io/projected/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-kube-api-access-jtckp\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.386104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.386067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-tmp\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.388527 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.388510    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6556d8945f-r947j"]
Sep 09 12:12:30.453275 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.453183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:30.479396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.479367    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mksrl\""
Sep 09 12:12:30.486363 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-ca-trust-extracted\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.486477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-registry-tls\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.486477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-image-registry-private-configuration\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.486477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-bound-sa-token\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.486477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-klusterlet-config\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.486609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486521    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-registry-certificates\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.486609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjjmv\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-kube-api-access-tjjmv\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.486609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-trusted-ca\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.486609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-installation-pull-secrets\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.486762 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gszrt\" (UniqueName: \"kubernetes.io/projected/26ecc0f2-68a1-4a42-8828-25be652520d4-kube-api-access-gszrt\") pod \"downloads-85d98c998f-f5k6k\" (UID: \"26ecc0f2-68a1-4a42-8828-25be652520d4\") " pod="openshift-console/downloads-85d98c998f-f5k6k"
Sep 09 12:12:30.486762 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtckp\" (UniqueName: \"kubernetes.io/projected/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-kube-api-access-jtckp\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.486762 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.486722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-tmp\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.487068 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.487052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-tmp\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.487899 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.487882    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:30.488853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.488834    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-klusterlet-config\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.494368 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.494277    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9k524"]
Sep 09 12:12:30.497014 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:30.496992    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96a723f_56e9_4550_92c9_abe553637eee.slice/crio-85ab256c393d2143f97bcb2e24ed9b50f96b32d18d707aa1c0358baa45cc06bf WatchSource:0}: Error finding container 85ab256c393d2143f97bcb2e24ed9b50f96b32d18d707aa1c0358baa45cc06bf: Status 404 returned error can't find the container with id 85ab256c393d2143f97bcb2e24ed9b50f96b32d18d707aa1c0358baa45cc06bf
Sep 09 12:12:30.500404 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.500380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtckp\" (UniqueName: \"kubernetes.io/projected/2af2ffc6-d578-42ac-8a2a-5bc1a229a587-kube-api-access-jtckp\") pod \"klusterlet-addon-workmgr-8548f87f54-mxmph\" (UID: \"2af2ffc6-d578-42ac-8a2a-5bc1a229a587\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.500650 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.500634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gszrt\" (UniqueName: \"kubernetes.io/projected/26ecc0f2-68a1-4a42-8828-25be652520d4-kube-api-access-gszrt\") pod \"downloads-85d98c998f-f5k6k\" (UID: \"26ecc0f2-68a1-4a42-8828-25be652520d4\") " pod="openshift-console/downloads-85d98c998f-f5k6k"
Sep 09 12:12:30.510428 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.510407    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5zgt\""
Sep 09 12:12:30.518492 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.518469    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6mbr9"]
Sep 09 12:12:30.518598 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.518512    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:12:30.522141 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:30.522115    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e6cf39_498b_441b_8c5f_4ab1851f60da.slice/crio-a457f8309d5ed0ef00d3adf965a2b6372afa2a1a36624f6f94b8f50ba2dfbb30 WatchSource:0}: Error finding container a457f8309d5ed0ef00d3adf965a2b6372afa2a1a36624f6f94b8f50ba2dfbb30: Status 404 returned error can't find the container with id a457f8309d5ed0ef00d3adf965a2b6372afa2a1a36624f6f94b8f50ba2dfbb30
Sep 09 12:12:30.548721 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.548697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:30.587393 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:30.587529 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-ca-trust-extracted\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.587529 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-registry-tls\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.587529 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-image-registry-private-configuration\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.587529 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-bound-sa-token\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.587529 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587524    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-registry-certificates\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.587788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjjmv\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-kube-api-access-tjjmv\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.587788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-trusted-ca\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.587788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.587648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-installation-pull-secrets\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.588395 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.588369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-ca-trust-extracted\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.588778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.588726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-registry-certificates\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.588778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.588773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-trusted-ca\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.590248 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.590146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-image-registry-private-configuration\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.590248 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.590199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ed2dc37-8e5a-401f-aefe-26f57c01e9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwngl\" (UID: \"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce\") " pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:30.590415 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.590388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-registry-tls\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.590717 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.590693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-installation-pull-secrets\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.597020 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.596995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-bound-sa-token\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.597948 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.597917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjjmv\" (UniqueName: \"kubernetes.io/projected/f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc-kube-api-access-tjjmv\") pod \"image-registry-6556d8945f-r947j\" (UID: \"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc\") " pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.622338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.622316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:30.644776 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.644752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:30.666952 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.666925    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-f5k6k"
Sep 09 12:12:30.679720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.679696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:30.683876 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.683852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9k524" event={"ID":"d96a723f-56e9-4550-92c9-abe553637eee","Type":"ContainerStarted","Data":"85ab256c393d2143f97bcb2e24ed9b50f96b32d18d707aa1c0358baa45cc06bf"}
Sep 09 12:12:30.685212 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.685180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6mbr9" event={"ID":"e4e6cf39-498b-441b-8c5f-4ab1851f60da","Type":"ContainerStarted","Data":"a457f8309d5ed0ef00d3adf965a2b6372afa2a1a36624f6f94b8f50ba2dfbb30"}
Sep 09 12:12:30.757548 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.757512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:30.774463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.774436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qm8dx"]
Sep 09 12:12:30.777393 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:30.777370    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2cb5506_1e6f_44b3_bdac_0d615d255d22.slice/crio-7351e6e30f143da068139ef251a48472975a723a3a4e5f976817b50f7a3baaa9 WatchSource:0}: Error finding container 7351e6e30f143da068139ef251a48472975a723a3a4e5f976817b50f7a3baaa9: Status 404 returned error can't find the container with id 7351e6e30f143da068139ef251a48472975a723a3a4e5f976817b50f7a3baaa9
Sep 09 12:12:30.806113 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.806092    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lrqz2\""
Sep 09 12:12:30.810188 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.810036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vwngl"
Sep 09 12:12:30.811084 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.811062    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7km7f"]
Sep 09 12:12:30.816983 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:30.816958    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795dad27_1e8b_43c8_9357_8896d43bc9db.slice/crio-d3aebcd57168f34df3086d846f69cd1a4c76da645790b47ad0d9e41e2f0149c9 WatchSource:0}: Error finding container d3aebcd57168f34df3086d846f69cd1a4c76da645790b47ad0d9e41e2f0149c9: Status 404 returned error can't find the container with id d3aebcd57168f34df3086d846f69cd1a4c76da645790b47ad0d9e41e2f0149c9
Sep 09 12:12:30.912167 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.912113    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"]
Sep 09 12:12:30.917652 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:30.917608    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af2ffc6_d578_42ac_8a2a_5bc1a229a587.slice/crio-6528db2ce1dd021492e3ccf70bf194d90948321e1357042150ff3a521f8f00ce WatchSource:0}: Error finding container 6528db2ce1dd021492e3ccf70bf194d90948321e1357042150ff3a521f8f00ce: Status 404 returned error can't find the container with id 6528db2ce1dd021492e3ccf70bf194d90948321e1357042150ff3a521f8f00ce
Sep 09 12:12:30.967578 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.967469    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-f5k6k"]
Sep 09 12:12:30.970691 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:30.970659    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ecc0f2_68a1_4a42_8828_25be652520d4.slice/crio-ec17cfb9fba110685a169b3ede9d040483180b2d525e2bb3adbb48695e0a14a1 WatchSource:0}: Error finding container ec17cfb9fba110685a169b3ede9d040483180b2d525e2bb3adbb48695e0a14a1: Status 404 returned error can't find the container with id ec17cfb9fba110685a169b3ede9d040483180b2d525e2bb3adbb48695e0a14a1
Sep 09 12:12:30.991508 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:30.991142    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6556d8945f-r947j"]
Sep 09 12:12:30.993670 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:30.993641    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8aaee3f_b63a_4d9c_ad27_d7da7aadebcc.slice/crio-949eb463938fb163c18df45dddce7bfcf535a90d1ebfcc590abe9a656446f8bd WatchSource:0}: Error finding container 949eb463938fb163c18df45dddce7bfcf535a90d1ebfcc590abe9a656446f8bd: Status 404 returned error can't find the container with id 949eb463938fb163c18df45dddce7bfcf535a90d1ebfcc590abe9a656446f8bd
Sep 09 12:12:31.092621 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.092597    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vwngl"]
Sep 09 12:12:31.094996 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:31.094965    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed2dc37_8e5a_401f_aefe_26f57c01e9ce.slice/crio-1e25b35b8276064aad0bba9dc74373e4d8beea9012a7eb0b4e35a6d451916a9c WatchSource:0}: Error finding container 1e25b35b8276064aad0bba9dc74373e4d8beea9012a7eb0b4e35a6d451916a9c: Status 404 returned error can't find the container with id 1e25b35b8276064aad0bba9dc74373e4d8beea9012a7eb0b4e35a6d451916a9c
Sep 09 12:12:31.692157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.692034    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwngl" event={"ID":"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce","Type":"ContainerStarted","Data":"7efaf0d575d8408d73e444b84295a21cf2a373cd4d5be6cfd6e657e78a81cb58"}
Sep 09 12:12:31.692157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.692104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwngl" event={"ID":"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce","Type":"ContainerStarted","Data":"1e25b35b8276064aad0bba9dc74373e4d8beea9012a7eb0b4e35a6d451916a9c"}
Sep 09 12:12:31.698369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.697176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6556d8945f-r947j" event={"ID":"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc","Type":"ContainerStarted","Data":"e49244cb8aba01345de942bb6bd29ffa307e3cc86e0f0d775419892fd6073b37"}
Sep 09 12:12:31.698369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.697233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6556d8945f-r947j" event={"ID":"f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc","Type":"ContainerStarted","Data":"949eb463938fb163c18df45dddce7bfcf535a90d1ebfcc590abe9a656446f8bd"}
Sep 09 12:12:31.698369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.697978    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:31.705178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.705043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7km7f" event={"ID":"795dad27-1e8b-43c8-9357-8896d43bc9db","Type":"ContainerStarted","Data":"64ae191ed366eb30788fd0ea329abd77df71c5747fd9b0018fdbcc6029840794"}
Sep 09 12:12:31.705178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.705128    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7km7f" event={"ID":"795dad27-1e8b-43c8-9357-8896d43bc9db","Type":"ContainerStarted","Data":"d3aebcd57168f34df3086d846f69cd1a4c76da645790b47ad0d9e41e2f0149c9"}
Sep 09 12:12:31.709233 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.705424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:12:31.709233 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.709149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-f5k6k" event={"ID":"26ecc0f2-68a1-4a42-8828-25be652520d4","Type":"ContainerStarted","Data":"ec17cfb9fba110685a169b3ede9d040483180b2d525e2bb3adbb48695e0a14a1"}
Sep 09 12:12:31.713233 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.713163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph" event={"ID":"2af2ffc6-d578-42ac-8a2a-5bc1a229a587","Type":"ContainerStarted","Data":"6528db2ce1dd021492e3ccf70bf194d90948321e1357042150ff3a521f8f00ce"}
Sep 09 12:12:31.716169 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.716109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qm8dx" event={"ID":"e2cb5506-1e6f-44b3-bdac-0d615d255d22","Type":"ContainerStarted","Data":"7351e6e30f143da068139ef251a48472975a723a3a4e5f976817b50f7a3baaa9"}
Sep 09 12:12:31.726648 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.725470    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6556d8945f-r947j" podStartSLOduration=1.72545419 podStartE2EDuration="1.72545419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:31.724271425 +0000 UTC m=+67.770396604" watchObservedRunningTime="2026-09-09 12:12:31.72545419 +0000 UTC m=+67.771579347"
Sep 09 12:12:31.743312 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:31.742506    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7km7f" podStartSLOduration=67.742489451 podStartE2EDuration="1m7.742489451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:31.740372414 +0000 UTC m=+67.786497593" watchObservedRunningTime="2026-09-09 12:12:31.742489451 +0000 UTC m=+67.788614630"
Sep 09 12:12:32.729818 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:32.729710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6mbr9" event={"ID":"e4e6cf39-498b-441b-8c5f-4ab1851f60da","Type":"ContainerStarted","Data":"f36191cfd62a092718f6d949a6b46756b51edd9e26b3d6038a01dda0313b7894"}
Sep 09 12:12:32.729818 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:32.729782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6mbr9" event={"ID":"e4e6cf39-498b-441b-8c5f-4ab1851f60da","Type":"ContainerStarted","Data":"c4918e1f450da9440dd21bdf0b73e1757aa16e41b272d97335495058dc0f82ff"}
Sep 09 12:12:32.735237 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:32.733951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwngl" event={"ID":"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce","Type":"ContainerStarted","Data":"e8c63a99ad7a545dc4de4d8dbb6c5397043a21cb844aa96e77723c1c3245767a"}
Sep 09 12:12:32.749107 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:32.749052    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6mbr9" podStartSLOduration=67.351136638 podStartE2EDuration="1m8.749031699s" totalImagesPullingTime="1.397895061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:32.747428219 +0000 UTC m=+68.793553398" watchObservedRunningTime="2026-09-09 12:12:32.749031699 +0000 UTC m=+68.795156880"
Sep 09 12:12:32.860350 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:32.860283    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:32.965237 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:32.965173    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:33.374881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:33.374794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:33.475778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:33.475696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:35.670821 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.670783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:35.712969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.712933    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-nccmg"]
Sep 09 12:12:35.734202 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.734123    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-nccmg"]
Sep 09 12:12:35.734372 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.734245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.737009 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.736980    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 12:12:35.737264 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.737244    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 12:12:35.737625 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.737603    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 12:12:35.738028 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.738007    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4sc2d\""
Sep 09 12:12:35.738419 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.738139    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 12:12:35.738419 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.738192    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 12:12:35.758220 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.758134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:35.830131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.830063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3978f786-3818-495d-92cc-97816796eb8c-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.830326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.830158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3978f786-3818-495d-92cc-97816796eb8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.830326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.830185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhc2t\" (UniqueName: \"kubernetes.io/projected/3978f786-3818-495d-92cc-97816796eb8c-kube-api-access-lhc2t\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.830326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.830214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3978f786-3818-495d-92cc-97816796eb8c-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.831760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.831727    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:35.931312 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.931211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3978f786-3818-495d-92cc-97816796eb8c-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.931477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.931313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3978f786-3818-495d-92cc-97816796eb8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.931477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.931344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhc2t\" (UniqueName: \"kubernetes.io/projected/3978f786-3818-495d-92cc-97816796eb8c-kube-api-access-lhc2t\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.931477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.931384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3978f786-3818-495d-92cc-97816796eb8c-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.932193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.932146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3978f786-3818-495d-92cc-97816796eb8c-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.934664 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.934631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3978f786-3818-495d-92cc-97816796eb8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.934782 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.934757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3978f786-3818-495d-92cc-97816796eb8c-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.942082 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.942054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhc2t\" (UniqueName: \"kubernetes.io/projected/3978f786-3818-495d-92cc-97816796eb8c-kube-api-access-lhc2t\") pod \"prometheus-operator-6f4946db56-nccmg\" (UID: \"3978f786-3818-495d-92cc-97816796eb8c\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:35.957115 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:35.957086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:36.047585 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:36.047553    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg"
Sep 09 12:12:38.053191 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.053065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:38.155614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.155578    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:38.417046 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.417012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:38.505643 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.505560    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-nccmg"]
Sep 09 12:12:38.511184 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:38.511156    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3978f786_3818_495d_92cc_97816796eb8c.slice/crio-d46d2c0aa416e80a0d5bf45609c23c81c9f07c783b5412acfe112d79eeb96ee2 WatchSource:0}: Error finding container d46d2c0aa416e80a0d5bf45609c23c81c9f07c783b5412acfe112d79eeb96ee2: Status 404 returned error can't find the container with id d46d2c0aa416e80a0d5bf45609c23c81c9f07c783b5412acfe112d79eeb96ee2
Sep 09 12:12:38.598463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.598378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:38.760891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.760854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9k524" event={"ID":"d96a723f-56e9-4550-92c9-abe553637eee","Type":"ContainerStarted","Data":"7e562a6b00cc29d9d6db71e6d6aed432fb71d536eda96390fb529aa140a7783b"}
Sep 09 12:12:38.763423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.763393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwngl" event={"ID":"1ed2dc37-8e5a-401f-aefe-26f57c01e9ce","Type":"ContainerStarted","Data":"6f27835e82b9b095453f1c5fbfb700138b0653b0aac90d01ec8ed2d868505fa4"}
Sep 09 12:12:38.764933 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.764905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph" event={"ID":"2af2ffc6-d578-42ac-8a2a-5bc1a229a587","Type":"ContainerStarted","Data":"10323bdb1f6fc5d328e009127700f4c5621b4301d8cb0d5b9370bc205021caae"}
Sep 09 12:12:38.765384 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.765361    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:38.769420 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.767592    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph"
Sep 09 12:12:38.770629 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.770605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qm8dx" event={"ID":"e2cb5506-1e6f-44b3-bdac-0d615d255d22","Type":"ContainerStarted","Data":"83085b8b072f639b80c8927f8d1783bf865bb493a6e6e161e743a06fe1dd31e3"}
Sep 09 12:12:38.770712 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.770650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qm8dx" event={"ID":"e2cb5506-1e6f-44b3-bdac-0d615d255d22","Type":"ContainerStarted","Data":"78f21d6003de24d946b49678fe2fecbdc0387e1c63a0a5a7da9750d785e3a2b4"}
Sep 09 12:12:38.770976 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.770945    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:38.772285 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.772262    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg" event={"ID":"3978f786-3818-495d-92cc-97816796eb8c","Type":"ContainerStarted","Data":"d46d2c0aa416e80a0d5bf45609c23c81c9f07c783b5412acfe112d79eeb96ee2"}
Sep 09 12:12:38.779668 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.779630    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9k524" podStartSLOduration=67.068806014 podStartE2EDuration="1m14.779618238s" totalImagesPullingTime="7.710812224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:38.778617334 +0000 UTC m=+74.824742513" watchObservedRunningTime="2026-09-09 12:12:38.779618238 +0000 UTC m=+74.825743409"
Sep 09 12:12:38.798459 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.798417    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qm8dx" podStartSLOduration=33.367667503 podStartE2EDuration="40.798401769s" totalImagesPullingTime="7.430734266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:38.797985606 +0000 UTC m=+74.844110784" watchObservedRunningTime="2026-09-09 12:12:38.798401769 +0000 UTC m=+74.844526951"
Sep 09 12:12:38.817847 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.817799    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vwngl" podStartSLOduration=33.811233349 podStartE2EDuration="40.8177803s" totalImagesPullingTime="7.006546951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:11:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:38.816638878 +0000 UTC m=+74.862764057" watchObservedRunningTime="2026-09-09 12:12:38.8177803 +0000 UTC m=+74.863905481"
Sep 09 12:12:38.836415 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:38.836368    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548f87f54-mxmph" podStartSLOduration=1.548178332 podStartE2EDuration="8.836351633s" totalImagesPullingTime="7.288173301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:38.83569624 +0000 UTC m=+74.881821422" watchObservedRunningTime="2026-09-09 12:12:38.836351633 +0000 UTC m=+74.882476814"
Sep 09 12:12:40.032696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:40.032586    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:40.362151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:40.362106    2560 patch_prober.go:28] interesting pod/image-registry-7488c4545b-v6b58 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 12:12:40.362324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:40.362165    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7488c4545b-v6b58" podUID="072bc001-0e4c-4000-bafc-0d50ad6b5065" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 12:12:40.441137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:40.441102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:40.516638 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:40.516604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:40.782238 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:40.782142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg" event={"ID":"3978f786-3818-495d-92cc-97816796eb8c","Type":"ContainerStarted","Data":"901d76022389ffe0119c569827a5f7437f7370a86e9bc4a6439f9f77bb8118ad"}
Sep 09 12:12:40.782238 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:40.782207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg" event={"ID":"3978f786-3818-495d-92cc-97816796eb8c","Type":"ContainerStarted","Data":"ff44f1266643a1ddbd8418710444b6e61f1e621c89417015c63930fe41462c7a"}
Sep 09 12:12:40.802087 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:40.802035    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-nccmg" podStartSLOduration=4.564968153 podStartE2EDuration="5.802020135s" totalImagesPullingTime="1.237051982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:40.800473025 +0000 UTC m=+76.846598220" watchObservedRunningTime="2026-09-09 12:12:40.802020135 +0000 UTC m=+76.848145312"
Sep 09 12:12:42.387416 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:42.387382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:42.446950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:42.446889    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:42.863772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:42.863735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:43.096927 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.096884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:43.145480 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.145394    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dvjjk"]
Sep 09 12:12:43.178660 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.178632    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.181060 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.181034    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xwtql\""
Sep 09 12:12:43.181201 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.181078    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 12:12:43.181201 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.181116    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 12:12:43.181201 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.181076    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 12:12:43.195259 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.195228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:43.263156 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.263117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:43.291270 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-accelerators-collector-config\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.291439 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-sys\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.291439 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-wtmp\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.291439 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-textfile\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.291439 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.291614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-tls\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.291614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f96f550b-1915-46da-8567-49ab09c2c025-metrics-client-ca\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.291614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-root\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.291614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.291570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgkfk\" (UniqueName: \"kubernetes.io/projected/f96f550b-1915-46da-8567-49ab09c2c025-kube-api-access-kgkfk\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.362701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.362665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:43.392729 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-tls\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f96f550b-1915-46da-8567-49ab09c2c025-metrics-client-ca\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-root\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgkfk\" (UniqueName: \"kubernetes.io/projected/f96f550b-1915-46da-8567-49ab09c2c025-kube-api-access-kgkfk\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-accelerators-collector-config\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-sys\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-wtmp\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-root\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-textfile\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.392977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393629 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.393230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-textfile\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393629 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.393323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-sys\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393629 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.393442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-wtmp\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393629 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.393442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f96f550b-1915-46da-8567-49ab09c2c025-metrics-client-ca\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.393826 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.393627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-accelerators-collector-config\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.395375 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.395350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-tls\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.396036 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.395964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f96f550b-1915-46da-8567-49ab09c2c025-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.402212 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.402189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgkfk\" (UniqueName: \"kubernetes.io/projected/f96f550b-1915-46da-8567-49ab09c2c025-kube-api-access-kgkfk\") pod \"node-exporter-dvjjk\" (UID: \"f96f550b-1915-46da-8567-49ab09c2c025\") " pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.466223 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.466173    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:43.488913 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.488883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dvjjk"
Sep 09 12:12:43.564004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:43.563945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:44.112506 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:44.112473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:44.197451 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:44.197412    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:44.432870 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:44.432783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:45.206543 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.206507    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5db554b64c-mzmvq"]
Sep 09 12:12:45.209956 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.209935    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.212610 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.212475    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a699443nsjaq7\""
Sep 09 12:12:45.212610 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.212488    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 12:12:45.212610 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.212493    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 12:12:45.213878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.213172    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 12:12:45.213878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.213226    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 12:12:45.213878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.213494    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qq6q5\""
Sep 09 12:12:45.213878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.213809    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 12:12:45.221514 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.221492    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5db554b64c-mzmvq"]
Sep 09 12:12:45.309155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.309118    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-tls\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.309345 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.309215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqpbz\" (UniqueName: \"kubernetes.io/projected/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-kube-api-access-cqpbz\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.309345 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.309268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.309345 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.309305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-grpc-tls\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.309534 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.309377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.309534 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.309423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.309534 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.309456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-metrics-client-ca\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.309534 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.309510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.410702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.410664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-metrics-client-ca\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.410854 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.410711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.410854 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.410757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-tls\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.410854 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.410794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqpbz\" (UniqueName: \"kubernetes.io/projected/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-kube-api-access-cqpbz\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.410854 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.410838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.411058 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.410862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-grpc-tls\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.411058 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.410895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.411058 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.410931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.411665 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.411634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-metrics-client-ca\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.413905 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.413876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.414026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.413876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.414253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.414232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-tls\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.414384 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.414336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.414663 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.414640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-grpc-tls\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.414841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.414801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.420175 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.420152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqpbz\" (UniqueName: \"kubernetes.io/projected/ef19eb43-4e1e-42c1-8a41-87d52d0564a1-kube-api-access-cqpbz\") pod \"thanos-querier-5db554b64c-mzmvq\" (UID: \"ef19eb43-4e1e-42c1-8a41-87d52d0564a1\") " pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:45.521805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:45.521718    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:46.093228 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:46.093162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:46.171128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:46.171088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:46.267995 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:46.267961    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:46.366960 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:46.366873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:47.197203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.197165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:47.282224 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.282190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:47.781807 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.781767    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc46ff56-6tgxr"]
Sep 09 12:12:47.785176 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.785146    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:47.787540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.787514    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 12:12:47.787540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.787530    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7pm6s\""
Sep 09 12:12:47.787540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.787537    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 12:12:47.788587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.788382    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 12:12:47.788587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.788444    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 12:12:47.788587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.788486    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 12:12:47.792436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.792414    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 12:12:47.798193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.798170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc46ff56-6tgxr"]
Sep 09 12:12:47.920119 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.920069    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"]
Sep 09 12:12:47.923486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.923460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:47.927682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.927616    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-p4lmq\""
Sep 09 12:12:47.927919 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.927899    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 12:12:47.932801 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.932779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-config\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:47.932917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.932828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx7ms\" (UniqueName: \"kubernetes.io/projected/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-kube-api-access-gx7ms\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:47.932917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.932894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-serving-cert\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:47.933021 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.932917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-trusted-ca-bundle\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:47.933021 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.932952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-service-ca\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:47.933021 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.932987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-oauth-serving-cert\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:47.933164 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.933019    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-oauth-config\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:47.941833 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:47.941809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"]
Sep 09 12:12:48.034129 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-config\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.034129 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034100    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx7ms\" (UniqueName: \"kubernetes.io/projected/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-kube-api-access-gx7ms\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.034429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/116bd7eb-18e2-4a54-89ad-d92b93fc370d-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9p5nf\" (UID: \"116bd7eb-18e2-4a54-89ad-d92b93fc370d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:48.034429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-serving-cert\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.034429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-trusted-ca-bundle\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.034429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-service-ca\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.034429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcgp7\" (UniqueName: \"kubernetes.io/projected/116bd7eb-18e2-4a54-89ad-d92b93fc370d-kube-api-access-xcgp7\") pod \"monitoring-plugin-85bbbbbf4-9p5nf\" (UID: \"116bd7eb-18e2-4a54-89ad-d92b93fc370d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:48.034429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-oauth-serving-cert\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.034705 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.034514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-oauth-config\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.035068 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.035030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-config\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.035197 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.035114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-oauth-serving-cert\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.035268 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.035207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-service-ca\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.035440 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.035418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-trusted-ca-bundle\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.036981 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.036961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-serving-cert\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.037403 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.037383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-oauth-config\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.043984 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.043962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx7ms\" (UniqueName: \"kubernetes.io/projected/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-kube-api-access-gx7ms\") pod \"console-7dc46ff56-6tgxr\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") " pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.095868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.095833    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:48.135156 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.135127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcgp7\" (UniqueName: \"kubernetes.io/projected/116bd7eb-18e2-4a54-89ad-d92b93fc370d-kube-api-access-xcgp7\") pod \"monitoring-plugin-85bbbbbf4-9p5nf\" (UID: \"116bd7eb-18e2-4a54-89ad-d92b93fc370d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:48.135340 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.135218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/116bd7eb-18e2-4a54-89ad-d92b93fc370d-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9p5nf\" (UID: \"116bd7eb-18e2-4a54-89ad-d92b93fc370d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:48.137678 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.137644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/116bd7eb-18e2-4a54-89ad-d92b93fc370d-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9p5nf\" (UID: \"116bd7eb-18e2-4a54-89ad-d92b93fc370d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:48.144937 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.144906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcgp7\" (UniqueName: \"kubernetes.io/projected/116bd7eb-18e2-4a54-89ad-d92b93fc370d-kube-api-access-xcgp7\") pod \"monitoring-plugin-85bbbbbf4-9p5nf\" (UID: \"116bd7eb-18e2-4a54-89ad-d92b93fc370d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:48.234882 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.234842    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:48.779053 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.779024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qm8dx"
Sep 09 12:12:48.899253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.899201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:48.970070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:48.970034    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:49.403809 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.403756    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:49.641331 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:49.641258    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96f550b_1915_46da_8567_49ab09c2c025.slice/crio-fb726f0f140b6b9cfebddc9f3f13060ccc7fe6c6911b3b9f111f354a2eccc098 WatchSource:0}: Error finding container fb726f0f140b6b9cfebddc9f3f13060ccc7fe6c6911b3b9f111f354a2eccc098: Status 404 returned error can't find the container with id fb726f0f140b6b9cfebddc9f3f13060ccc7fe6c6911b3b9f111f354a2eccc098
Sep 09 12:12:49.817890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.817855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvjjk" event={"ID":"f96f550b-1915-46da-8567-49ab09c2c025","Type":"ContainerStarted","Data":"fb726f0f140b6b9cfebddc9f3f13060ccc7fe6c6911b3b9f111f354a2eccc098"}
Sep 09 12:12:49.821427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.819453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-f5k6k" event={"ID":"26ecc0f2-68a1-4a42-8828-25be652520d4","Type":"ContainerStarted","Data":"ef5f68102b266ac7cd61957649b88c3cf5ff074c3f6004536fa1e0944adc0077"}
Sep 09 12:12:49.821427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.820356    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-f5k6k"
Sep 09 12:12:49.821725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.821701    2560 patch_prober.go:28] interesting pod/downloads-85d98c998f-f5k6k container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" start-of-body=
Sep 09 12:12:49.821830 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.821757    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-f5k6k" podUID="26ecc0f2-68a1-4a42-8828-25be652520d4" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused"
Sep 09 12:12:49.841246 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.840360    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-f5k6k" podStartSLOduration=1.072422134 podStartE2EDuration="19.840340962s" totalImagesPullingTime="18.767918828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:49.839613119 +0000 UTC m=+85.885738326" watchObservedRunningTime="2026-09-09 12:12:49.840340962 +0000 UTC m=+85.886466140"
Sep 09 12:12:49.925068 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.924925    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"]
Sep 09 12:12:49.925762 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.925726    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc46ff56-6tgxr"]
Sep 09 12:12:49.927642 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:49.927476    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5db554b64c-mzmvq"]
Sep 09 12:12:49.927743 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:49.927690    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116bd7eb_18e2_4a54_89ad_d92b93fc370d.slice/crio-2e5a17bc62044989dc8f80cea2a04b19f0ac50c9518723a368825636d3dab1ec WatchSource:0}: Error finding container 2e5a17bc62044989dc8f80cea2a04b19f0ac50c9518723a368825636d3dab1ec: Status 404 returned error can't find the container with id 2e5a17bc62044989dc8f80cea2a04b19f0ac50c9518723a368825636d3dab1ec
Sep 09 12:12:49.928651 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:49.928600    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef19eb43_4e1e_42c1_8a41_87d52d0564a1.slice/crio-3ce03f5a69a46509ac3b72540b07ef4967af8cf7b9d6b4f40f5433961b10035e WatchSource:0}: Error finding container 3ce03f5a69a46509ac3b72540b07ef4967af8cf7b9d6b4f40f5433961b10035e: Status 404 returned error can't find the container with id 3ce03f5a69a46509ac3b72540b07ef4967af8cf7b9d6b4f40f5433961b10035e
Sep 09 12:12:49.929885 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:12:49.929837    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04d51b9_c6c5_458f_bc0b_c396d9ba19d7.slice/crio-04dda17d24402ea2969228e66a4a499914469f6f6989b3d6e45bb2ee80fe9e91 WatchSource:0}: Error finding container 04dda17d24402ea2969228e66a4a499914469f6f6989b3d6e45bb2ee80fe9e91: Status 404 returned error can't find the container with id 04dda17d24402ea2969228e66a4a499914469f6f6989b3d6e45bb2ee80fe9e91
Sep 09 12:12:50.360953 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:50.360874    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:50.685491 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:50.685408    2560 patch_prober.go:28] interesting pod/image-registry-6556d8945f-r947j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 12:12:50.685928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:50.685480    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6556d8945f-r947j" podUID="f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 12:12:50.826377 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:50.826330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvjjk" event={"ID":"f96f550b-1915-46da-8567-49ab09c2c025","Type":"ContainerStarted","Data":"446e2964d0970e474a49c2a5f63954725005bc55f8efe0392e82206fc68cc573"}
Sep 09 12:12:50.828505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:50.828383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq" event={"ID":"ef19eb43-4e1e-42c1-8a41-87d52d0564a1","Type":"ContainerStarted","Data":"3ce03f5a69a46509ac3b72540b07ef4967af8cf7b9d6b4f40f5433961b10035e"}
Sep 09 12:12:50.832632 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:50.832605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf" event={"ID":"116bd7eb-18e2-4a54-89ad-d92b93fc370d","Type":"ContainerStarted","Data":"2e5a17bc62044989dc8f80cea2a04b19f0ac50c9518723a368825636d3dab1ec"}
Sep 09 12:12:50.836315 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:50.836164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc46ff56-6tgxr" event={"ID":"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7","Type":"ContainerStarted","Data":"04dda17d24402ea2969228e66a4a499914469f6f6989b3d6e45bb2ee80fe9e91"}
Sep 09 12:12:50.840598 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:50.840526    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-f5k6k"
Sep 09 12:12:51.847577 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:51.847472    2560 generic.go:356] "Generic (PLEG): container finished" podID="f96f550b-1915-46da-8567-49ab09c2c025" containerID="446e2964d0970e474a49c2a5f63954725005bc55f8efe0392e82206fc68cc573" exitCode=0
Sep 09 12:12:51.847577 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:51.847562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvjjk" event={"ID":"f96f550b-1915-46da-8567-49ab09c2c025","Type":"ContainerDied","Data":"446e2964d0970e474a49c2a5f63954725005bc55f8efe0392e82206fc68cc573"}
Sep 09 12:12:52.418689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.418658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:52.491879 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.491735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:52.858322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.858143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvjjk" event={"ID":"f96f550b-1915-46da-8567-49ab09c2c025","Type":"ContainerStarted","Data":"6852d578ad77dd0ffdcf710b5b918406a770e8197c384e6500d28c2c2da012e6"}
Sep 09 12:12:52.858322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.858202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvjjk" event={"ID":"f96f550b-1915-46da-8567-49ab09c2c025","Type":"ContainerStarted","Data":"c6bff6371687a6c5d3f699d89049dac67396f37b85e68729db56c4cda60aec0e"}
Sep 09 12:12:52.862621 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.862566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf" event={"ID":"116bd7eb-18e2-4a54-89ad-d92b93fc370d","Type":"ContainerStarted","Data":"0c4bb9980548b5d1f806a44eb9ec527e445034a507f1ce5884e95fbc5ae31c29"}
Sep 09 12:12:52.863127 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.862919    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:52.869578 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.869525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf"
Sep 09 12:12:52.881719 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.881508    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dvjjk" podStartSLOduration=8.761792099000001 podStartE2EDuration="9.881490764s" totalImagesPullingTime="1.023163792s" totalInitContainerRuntime="96.534873ms" isStatefulPod=true podCreationTimestamp="2026-09-09 12:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:52.881149641 +0000 UTC m=+88.927274820" watchObservedRunningTime="2026-09-09 12:12:52.881490764 +0000 UTC m=+88.927615943"
Sep 09 12:12:52.899102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:52.898389    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9p5nf" podStartSLOduration=3.581701963 podStartE2EDuration="5.898370182s" totalImagesPullingTime="2.316668219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:52.896955916 +0000 UTC m=+88.943081095" watchObservedRunningTime="2026-09-09 12:12:52.898370182 +0000 UTC m=+88.944495372"
Sep 09 12:12:53.745322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:53.745228    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6556d8945f-r947j"
Sep 09 12:12:53.902530 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:53.902441    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:54.004212 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:54.004123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:54.800021 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:54.799949    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc46ff56-6tgxr"]
Sep 09 12:12:55.002273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:55.002160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:55.085751 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:55.085629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:55.374946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:55.374847    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7488c4545b-v6b58" podUID="072bc001-0e4c-4000-bafc-0d50ad6b5065" containerName="registry" containerID="cri-o://0c0b408855f351d8d94518b26723f3324c7cb782555d1b96b45260ef6ee01503" gracePeriod=30
Sep 09 12:12:55.878918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:55.878889    2560 generic.go:356] "Generic (PLEG): container finished" podID="072bc001-0e4c-4000-bafc-0d50ad6b5065" containerID="0c0b408855f351d8d94518b26723f3324c7cb782555d1b96b45260ef6ee01503" exitCode=0
Sep 09 12:12:55.879049 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:55.878962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7488c4545b-v6b58" event={"ID":"072bc001-0e4c-4000-bafc-0d50ad6b5065","Type":"ContainerDied","Data":"0c0b408855f351d8d94518b26723f3324c7cb782555d1b96b45260ef6ee01503"}
Sep 09 12:12:56.016124 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.016095    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:56.114665 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.114636    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/072bc001-0e4c-4000-bafc-0d50ad6b5065-ca-trust-extracted\") pod \"072bc001-0e4c-4000-bafc-0d50ad6b5065\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") "
Sep 09 12:12:56.114794 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.114677    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j29mq\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-kube-api-access-j29mq\") pod \"072bc001-0e4c-4000-bafc-0d50ad6b5065\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") "
Sep 09 12:12:56.114794 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.114697    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-trusted-ca\") pod \"072bc001-0e4c-4000-bafc-0d50ad6b5065\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") "
Sep 09 12:12:56.114794 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.114744    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") pod \"072bc001-0e4c-4000-bafc-0d50ad6b5065\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") "
Sep 09 12:12:56.114794 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.114776    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-installation-pull-secrets\") pod \"072bc001-0e4c-4000-bafc-0d50ad6b5065\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") "
Sep 09 12:12:56.114988 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.114824    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-image-registry-private-configuration\") pod \"072bc001-0e4c-4000-bafc-0d50ad6b5065\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") "
Sep 09 12:12:56.114988 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.114848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-certificates\") pod \"072bc001-0e4c-4000-bafc-0d50ad6b5065\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") "
Sep 09 12:12:56.114988 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.114896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-bound-sa-token\") pod \"072bc001-0e4c-4000-bafc-0d50ad6b5065\" (UID: \"072bc001-0e4c-4000-bafc-0d50ad6b5065\") "
Sep 09 12:12:56.115324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.115271    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "072bc001-0e4c-4000-bafc-0d50ad6b5065" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:12:56.115743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.115711    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "072bc001-0e4c-4000-bafc-0d50ad6b5065" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:12:56.119056 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.119022    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "072bc001-0e4c-4000-bafc-0d50ad6b5065" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:12:56.119169 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.119121    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "072bc001-0e4c-4000-bafc-0d50ad6b5065" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:12:56.119288 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.119268    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-kube-api-access-j29mq" (OuterVolumeSpecName: "kube-api-access-j29mq") pod "072bc001-0e4c-4000-bafc-0d50ad6b5065" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065"). InnerVolumeSpecName "kube-api-access-j29mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:12:56.119377 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.119347    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "072bc001-0e4c-4000-bafc-0d50ad6b5065" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:12:56.119612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.119590    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "072bc001-0e4c-4000-bafc-0d50ad6b5065" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:12:56.128169 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.128143    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072bc001-0e4c-4000-bafc-0d50ad6b5065-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "072bc001-0e4c-4000-bafc-0d50ad6b5065" (UID: "072bc001-0e4c-4000-bafc-0d50ad6b5065"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:12:56.183268 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.183234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:56.215733 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.215705    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:12:56.215921 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.215903    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-installation-pull-secrets\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:12:56.216038 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.216025    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/072bc001-0e4c-4000-bafc-0d50ad6b5065-image-registry-private-configuration\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:12:56.216133 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.216123    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-registry-certificates\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:12:56.216228 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.216217    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-bound-sa-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:12:56.216351 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.216338    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/072bc001-0e4c-4000-bafc-0d50ad6b5065-ca-trust-extracted\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:12:56.216461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.216449    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j29mq\" (UniqueName: \"kubernetes.io/projected/072bc001-0e4c-4000-bafc-0d50ad6b5065-kube-api-access-j29mq\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:12:56.216566 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.216555    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/072bc001-0e4c-4000-bafc-0d50ad6b5065-trusted-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:12:56.282348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.282285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:12:56.887476 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.887448    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7488c4545b-v6b58"
Sep 09 12:12:56.887655 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.887448    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7488c4545b-v6b58" event={"ID":"072bc001-0e4c-4000-bafc-0d50ad6b5065","Type":"ContainerDied","Data":"00ea80323f112b33f959bbd092b05e829f9f188f5823e7b2e03ed53b09ddb917"}
Sep 09 12:12:56.887655 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.887587    2560 scope.go:117] "RemoveContainer" containerID="0c0b408855f351d8d94518b26723f3324c7cb782555d1b96b45260ef6ee01503"
Sep 09 12:12:56.892669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.892397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc46ff56-6tgxr" event={"ID":"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7","Type":"ContainerStarted","Data":"0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135"}
Sep 09 12:12:56.898775 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.898746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq" event={"ID":"ef19eb43-4e1e-42c1-8a41-87d52d0564a1","Type":"ContainerStarted","Data":"22a82a85a732ef7782beb2a79e3df62cdb0c2edd7a301faa10f4778d7f9fa9be"}
Sep 09 12:12:56.899071 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.898999    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq" event={"ID":"ef19eb43-4e1e-42c1-8a41-87d52d0564a1","Type":"ContainerStarted","Data":"f32f50373389137a1afb2892735f9c6ea05c2d5d43796f2a716281d8c489377e"}
Sep 09 12:12:56.899677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.899580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq" event={"ID":"ef19eb43-4e1e-42c1-8a41-87d52d0564a1","Type":"ContainerStarted","Data":"450d6a4d98f33bc64151feaa02545b31c48f74b8b72061e2948c79e04a9efe18"}
Sep 09 12:12:56.908242 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.908218    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7488c4545b-v6b58"]
Sep 09 12:12:56.915754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.915701    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7488c4545b-v6b58"]
Sep 09 12:12:56.935426 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:56.935369    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc46ff56-6tgxr" podStartSLOduration=3.835491265 podStartE2EDuration="9.935348904s" totalImagesPullingTime="6.099857639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:56.933619977 +0000 UTC m=+92.979745154" watchObservedRunningTime="2026-09-09 12:12:56.935348904 +0000 UTC m=+92.981474083"
Sep 09 12:12:57.908284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:57.908252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq" event={"ID":"ef19eb43-4e1e-42c1-8a41-87d52d0564a1","Type":"ContainerStarted","Data":"cf94bc50cc62fc81499f7e1ea29be6eeeda37e1f57a27601fd220f2acece2f78"}
Sep 09 12:12:57.908677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:57.908376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq" event={"ID":"ef19eb43-4e1e-42c1-8a41-87d52d0564a1","Type":"ContainerStarted","Data":"18190931457ec11855b366b955bc5fb5129892c70ebb4321945bedd06d5f2ab6"}
Sep 09 12:12:58.096946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:58.096904    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:12:58.400256 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:58.400217    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="072bc001-0e4c-4000-bafc-0d50ad6b5065" path="/var/lib/kubelet/pods/072bc001-0e4c-4000-bafc-0d50ad6b5065/volumes"
Sep 09 12:12:58.914845 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:58.914801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq" event={"ID":"ef19eb43-4e1e-42c1-8a41-87d52d0564a1","Type":"ContainerStarted","Data":"1fdb576259e7dc52ccb8efc4da03c6b92e8fee6efe1d64abb2bf162f47e89ab5"}
Sep 09 12:12:58.915326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:58.914922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:12:58.943035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:12:58.942982    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq" podStartSLOduration=6.621504495 podStartE2EDuration="13.942966255s" totalImagesPullingTime="7.32146176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:12:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:12:58.941595325 +0000 UTC m=+94.987720506" watchObservedRunningTime="2026-09-09 12:12:58.942966255 +0000 UTC m=+94.989091433"
Sep 09 12:13:00.199817 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:00.199780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:00.281485 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:00.281446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:01.427986 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:01.427948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:01.503282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:01.503247    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:02.736899 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:02.736872    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7km7f"
Sep 09 12:13:03.651494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:03.651457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:03.767205 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:03.767171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:03.867202 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:03.867159    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:03.962844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:03.962762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:04.924502 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:04.924475    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5db554b64c-mzmvq"
Sep 09 12:13:05.647585 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:05.647548    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:05.746084 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:05.746043    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:08.569914 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:08.569875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:08.671662 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:08.671632    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:10.455640 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:10.455608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:10.556356 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:10.556308    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:13.000400 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:13.000366    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:13.101637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:13.101598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:16.991718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:16.991679    2560 generic.go:356] "Generic (PLEG): container finished" podID="6c720f6f-269a-4d99-b67f-354d268eeabb" containerID="34c5326fae769eb1b807591a68909b357a3774ae948b4b15a010e4b2686bd481" exitCode=0
Sep 09 12:13:16.992115 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:16.991742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw" event={"ID":"6c720f6f-269a-4d99-b67f-354d268eeabb","Type":"ContainerDied","Data":"34c5326fae769eb1b807591a68909b357a3774ae948b4b15a010e4b2686bd481"}
Sep 09 12:13:16.992162 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:16.992119    2560 scope.go:117] "RemoveContainer" containerID="34c5326fae769eb1b807591a68909b357a3774ae948b4b15a010e4b2686bd481"
Sep 09 12:13:17.850278 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:17.850208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:17.926074 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:17.926038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:17.997445 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:17.997415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9htlw" event={"ID":"6c720f6f-269a-4d99-b67f-354d268eeabb","Type":"ContainerStarted","Data":"4e065df7fcf909e28778235ee2857d5c92cd823992627680e6dd43cbd622342e"}
Sep 09 12:13:21.917074 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:21.917030    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dc46ff56-6tgxr" podUID="d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" containerName="console" containerID="cri-o://0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135" gracePeriod=15
Sep 09 12:13:22.183601 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.183541    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:13:22.222096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222059    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-oauth-serving-cert\") pod \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") "
Sep 09 12:13:22.222227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222118    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-serving-cert\") pod \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") "
Sep 09 12:13:22.222227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-oauth-config\") pod \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") "
Sep 09 12:13:22.222227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222195    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-config\") pod \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") "
Sep 09 12:13:22.222498 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222237    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-trusted-ca-bundle\") pod \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") "
Sep 09 12:13:22.222498 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222262    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx7ms\" (UniqueName: \"kubernetes.io/projected/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-kube-api-access-gx7ms\") pod \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") "
Sep 09 12:13:22.222498 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222301    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-service-ca\") pod \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\" (UID: \"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7\") "
Sep 09 12:13:22.222657 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222471    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" (UID: "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:13:22.222712 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222680    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" (UID: "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:13:22.222772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-config" (OuterVolumeSpecName: "console-config") pod "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" (UID: "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:13:22.222772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.222721    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" (UID: "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:13:22.224502 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.224479    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" (UID: "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:13:22.224592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.224522    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-kube-api-access-gx7ms" (OuterVolumeSpecName: "kube-api-access-gx7ms") pod "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" (UID: "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7"). InnerVolumeSpecName "kube-api-access-gx7ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:13:22.224656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.224635    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" (UID: "d04d51b9-c6c5-458f-bc0b-c396d9ba19d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:13:22.322762 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.322736    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-serving-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:13:22.322762 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.322761    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-oauth-config\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:13:22.322918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.322770    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-console-config\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:13:22.322918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.322779    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-trusted-ca-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:13:22.322918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.322787    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx7ms\" (UniqueName: \"kubernetes.io/projected/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-kube-api-access-gx7ms\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:13:22.322918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.322796    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:13:22.322918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:22.322804    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7-oauth-serving-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:13:23.018573 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.018539    2560 generic.go:356] "Generic (PLEG): container finished" podID="d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" containerID="0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135" exitCode=0
Sep 09 12:13:23.019011 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.018580    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc46ff56-6tgxr"
Sep 09 12:13:23.019011 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.018622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc46ff56-6tgxr" event={"ID":"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7","Type":"ContainerDied","Data":"0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135"}
Sep 09 12:13:23.019011 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.018670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc46ff56-6tgxr" event={"ID":"d04d51b9-c6c5-458f-bc0b-c396d9ba19d7","Type":"ContainerDied","Data":"04dda17d24402ea2969228e66a4a499914469f6f6989b3d6e45bb2ee80fe9e91"}
Sep 09 12:13:23.019011 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.018690    2560 scope.go:117] "RemoveContainer" containerID="0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135"
Sep 09 12:13:23.026638 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.026625    2560 scope.go:117] "RemoveContainer" containerID="0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135"
Sep 09 12:13:23.026922 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:13:23.026898    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135\": container with ID starting with 0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135 not found: ID does not exist" containerID="0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135"
Sep 09 12:13:23.027015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.026926    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135"} err="failed to get container status \"0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135\": rpc error: code = NotFound desc = could not find container \"0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135\": container with ID starting with 0c672f031c71803cb3cd84d4350c61bae58c454c6b49041b6936074a4ae56135 not found: ID does not exist"
Sep 09 12:13:23.037046 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.037022    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc46ff56-6tgxr"]
Sep 09 12:13:23.039010 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:23.038990    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc46ff56-6tgxr"]
Sep 09 12:13:24.399093 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:24.399064    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" path="/var/lib/kubelet/pods/d04d51b9-c6c5-458f-bc0b-c396d9ba19d7/volumes"
Sep 09 12:13:25.430384 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:25.430338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:25.514931 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:25.514900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:34.877901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:34.877871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:40.426326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:40.426270    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:13:40.489779 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:13:40.489744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:02.469154 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:02.469117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:02.603288 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:02.603244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:10.982044 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:10.982007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:11.081438 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:11.081396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:11.182240 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:11.182198    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:11.693411 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:11.693368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:11.794959 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:11.794921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:21.941698 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:21.941612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:22.034718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:22.034686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:34.045054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:34.045018    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:34.107676 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:34.107647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:14:35.185789 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:14:35.185754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:17.685835 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:17.685798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:18.051718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:18.051638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:26.883131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.883103    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f65d7cd4c-tktjq"]
Sep 09 12:15:26.883505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.883383    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="072bc001-0e4c-4000-bafc-0d50ad6b5065" containerName="registry"
Sep 09 12:15:26.883505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.883394    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="072bc001-0e4c-4000-bafc-0d50ad6b5065" containerName="registry"
Sep 09 12:15:26.883505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.883403    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" containerName="console"
Sep 09 12:15:26.883505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.883409    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" containerName="console"
Sep 09 12:15:26.883505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.883459    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="072bc001-0e4c-4000-bafc-0d50ad6b5065" containerName="registry"
Sep 09 12:15:26.883505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.883467    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04d51b9-c6c5-458f-bc0b-c396d9ba19d7" containerName="console"
Sep 09 12:15:26.885084 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.885069    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:26.887553 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.887522    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 12:15:26.888487 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.888467    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7pm6s\""
Sep 09 12:15:26.888625 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.888610    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 12:15:26.888710 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.888640    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 12:15:26.888710 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.888658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 12:15:26.888863 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.888760    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 12:15:26.894181 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.894158    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 12:15:26.896978 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.896959    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f65d7cd4c-tktjq"]
Sep 09 12:15:26.952561 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:26.952535    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:27.048701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.048665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-serving-cert\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.048888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.048716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fszlw\" (UniqueName: \"kubernetes.io/projected/cf2e4e41-a979-4cf2-8399-dbd395b83642-kube-api-access-fszlw\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.048888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.048745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-service-ca\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.048888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.048772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-trusted-ca-bundle\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.048888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.048812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-oauth-serving-cert\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.048888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.048837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-oauth-config\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.048888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.048864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-config\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.149957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.149882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-serving-cert\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.149957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.149921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fszlw\" (UniqueName: \"kubernetes.io/projected/cf2e4e41-a979-4cf2-8399-dbd395b83642-kube-api-access-fszlw\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.149957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.149940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-service-ca\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.150211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.149970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-trusted-ca-bundle\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.150211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.150013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-oauth-serving-cert\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.150211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.150039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-oauth-config\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.150211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.150066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-config\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.150776 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.150749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-service-ca\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.150776 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.150766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-config\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.150963 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.150751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-oauth-serving-cert\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.150963 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.150952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-trusted-ca-bundle\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.152472 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.152447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-oauth-config\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.152567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.152541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-serving-cert\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.159307 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.159275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fszlw\" (UniqueName: \"kubernetes.io/projected/cf2e4e41-a979-4cf2-8399-dbd395b83642-kube-api-access-fszlw\") pod \"console-5f65d7cd4c-tktjq\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") " pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.194324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.194280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:27.454844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.454758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:27.491827 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.491798    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f65d7cd4c-tktjq"]
Sep 09 12:15:27.495548 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:15:27.495524    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2e4e41_a979_4cf2_8399_dbd395b83642.slice/crio-5d4c5300e9c8905e7a256b5a4bd34000f12b3c09d71098b8905bc1cb17b4ce68 WatchSource:0}: Error finding container 5d4c5300e9c8905e7a256b5a4bd34000f12b3c09d71098b8905bc1cb17b4ce68: Status 404 returned error can't find the container with id 5d4c5300e9c8905e7a256b5a4bd34000f12b3c09d71098b8905bc1cb17b4ce68
Sep 09 12:15:27.863077 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.863001    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:27.961120 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:27.961072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:28.464318 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:28.464266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f65d7cd4c-tktjq" event={"ID":"cf2e4e41-a979-4cf2-8399-dbd395b83642","Type":"ContainerStarted","Data":"b6b0235281595d02f3b36030c437803b849e232d869423506a5b84635dff7c08"}
Sep 09 12:15:28.464525 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:28.464333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f65d7cd4c-tktjq" event={"ID":"cf2e4e41-a979-4cf2-8399-dbd395b83642","Type":"ContainerStarted","Data":"5d4c5300e9c8905e7a256b5a4bd34000f12b3c09d71098b8905bc1cb17b4ce68"}
Sep 09 12:15:28.489148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:28.489090    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f65d7cd4c-tktjq" podStartSLOduration=2.489070519 podStartE2EDuration="2.489070519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:15:28.488360314 +0000 UTC m=+244.534485492" watchObservedRunningTime="2026-09-09 12:15:28.489070519 +0000 UTC m=+244.535195699"
Sep 09 12:15:29.774926 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:29.774887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:29.842744 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:29.842714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:37.195399 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:37.195349    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:37.195399 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:37.195417    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:37.200191 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:37.200170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:37.500453 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:37.500374    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:15:37.719996 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:37.719964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:37.822923 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:37.822889    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:40.451127 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:40.451090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:40.546736 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:40.546701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:15:40.616478 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:15:40.616444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:16:18.362751 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:18.362712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:16:18.428087 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:18.428054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:16:24.297388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:24.297356    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:16:24.298536 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:24.298516    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:16:24.300814 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:24.300795    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 12:16:30.754840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:30.754807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:16:31.302973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.302938    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"]
Sep 09 12:16:31.305634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.305619    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.308378 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.308348    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 12:16:31.308510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.308377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v5gb7\""
Sep 09 12:16:31.308510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.308430    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 12:16:31.317493 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.317470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"]
Sep 09 12:16:31.425639 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.425592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whd8q\" (UniqueName: \"kubernetes.io/projected/9889645e-b132-40a1-94e0-95dc7a772465-kube-api-access-whd8q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.425803 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.425654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.425803 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.425735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.526706 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.526675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.526830 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.526723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whd8q\" (UniqueName: \"kubernetes.io/projected/9889645e-b132-40a1-94e0-95dc7a772465-kube-api-access-whd8q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.526867 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.526840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.527069 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.527050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.527103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.527087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.541560 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.541531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whd8q\" (UniqueName: \"kubernetes.io/projected/9889645e-b132-40a1-94e0-95dc7a772465-kube-api-access-whd8q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.613963 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.613927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:31.882646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.882575    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"]
Sep 09 12:16:31.885696 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:16:31.885672    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9889645e_b132_40a1_94e0_95dc7a772465.slice/crio-dcaaa55939959e9c6e7fe8fbb215356ac33353e09c315d4ad2ff8a604768e6a1 WatchSource:0}: Error finding container dcaaa55939959e9c6e7fe8fbb215356ac33353e09c315d4ad2ff8a604768e6a1: Status 404 returned error can't find the container with id dcaaa55939959e9c6e7fe8fbb215356ac33353e09c315d4ad2ff8a604768e6a1
Sep 09 12:16:31.887881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:31.887866    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 12:16:32.699387 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:32.699348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2" event={"ID":"9889645e-b132-40a1-94e0-95dc7a772465","Type":"ContainerStarted","Data":"dcaaa55939959e9c6e7fe8fbb215356ac33353e09c315d4ad2ff8a604768e6a1"}
Sep 09 12:16:33.103439 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:33.103409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:16:39.730146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:39.730108    2560 generic.go:356] "Generic (PLEG): container finished" podID="9889645e-b132-40a1-94e0-95dc7a772465" containerID="c3ef9351b64340df278b7111c4e92d95e65e24e0ce4da2f65c7df45aaf5ae713" exitCode=0
Sep 09 12:16:39.730554 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:39.730199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2" event={"ID":"9889645e-b132-40a1-94e0-95dc7a772465","Type":"ContainerDied","Data":"c3ef9351b64340df278b7111c4e92d95e65e24e0ce4da2f65c7df45aaf5ae713"}
Sep 09 12:16:42.744338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:42.744278    2560 generic.go:356] "Generic (PLEG): container finished" podID="9889645e-b132-40a1-94e0-95dc7a772465" containerID="90c48c6241f5b61dda074fe0f2c1f649847e1d0cca3f41d8da77c2f384f0ea99" exitCode=0
Sep 09 12:16:42.744338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:42.744323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2" event={"ID":"9889645e-b132-40a1-94e0-95dc7a772465","Type":"ContainerDied","Data":"90c48c6241f5b61dda074fe0f2c1f649847e1d0cca3f41d8da77c2f384f0ea99"}
Sep 09 12:16:49.776078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:49.776041    2560 generic.go:356] "Generic (PLEG): container finished" podID="9889645e-b132-40a1-94e0-95dc7a772465" containerID="0e4e8d7c7e30f5171a290d6aba4bf2e770ca88829107a4bff2541712cbb37417" exitCode=0
Sep 09 12:16:49.776567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:49.776125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2" event={"ID":"9889645e-b132-40a1-94e0-95dc7a772465","Type":"ContainerDied","Data":"0e4e8d7c7e30f5171a290d6aba4bf2e770ca88829107a4bff2541712cbb37417"}
Sep 09 12:16:50.901090 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:50.901067    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:50.997894 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:50.997854    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-bundle\") pod \"9889645e-b132-40a1-94e0-95dc7a772465\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") "
Sep 09 12:16:50.998057 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:50.997964    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whd8q\" (UniqueName: \"kubernetes.io/projected/9889645e-b132-40a1-94e0-95dc7a772465-kube-api-access-whd8q\") pod \"9889645e-b132-40a1-94e0-95dc7a772465\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") "
Sep 09 12:16:50.998057 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:50.997992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-util\") pod \"9889645e-b132-40a1-94e0-95dc7a772465\" (UID: \"9889645e-b132-40a1-94e0-95dc7a772465\") "
Sep 09 12:16:50.998604 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:50.998578    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-bundle" (OuterVolumeSpecName: "bundle") pod "9889645e-b132-40a1-94e0-95dc7a772465" (UID: "9889645e-b132-40a1-94e0-95dc7a772465"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:16:51.000112 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:51.000090    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9889645e-b132-40a1-94e0-95dc7a772465-kube-api-access-whd8q" (OuterVolumeSpecName: "kube-api-access-whd8q") pod "9889645e-b132-40a1-94e0-95dc7a772465" (UID: "9889645e-b132-40a1-94e0-95dc7a772465"). InnerVolumeSpecName "kube-api-access-whd8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:16:51.002275 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:51.002249    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-util" (OuterVolumeSpecName: "util") pod "9889645e-b132-40a1-94e0-95dc7a772465" (UID: "9889645e-b132-40a1-94e0-95dc7a772465"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:16:51.098697 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:51.098649    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whd8q\" (UniqueName: \"kubernetes.io/projected/9889645e-b132-40a1-94e0-95dc7a772465-kube-api-access-whd8q\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:16:51.098697 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:51.098696    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-util\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:16:51.098884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:51.098710    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9889645e-b132-40a1-94e0-95dc7a772465-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:16:51.791067 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:51.791030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2" event={"ID":"9889645e-b132-40a1-94e0-95dc7a772465","Type":"ContainerDied","Data":"dcaaa55939959e9c6e7fe8fbb215356ac33353e09c315d4ad2ff8a604768e6a1"}
Sep 09 12:16:51.791240 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:51.791107    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcaaa55939959e9c6e7fe8fbb215356ac33353e09c315d4ad2ff8a604768e6a1"
Sep 09 12:16:51.791240 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:51.791039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407gxv2"
Sep 09 12:16:57.914203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:57.914172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:16:58.040129 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:16:58.040094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:00.204083 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.204049    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"]
Sep 09 12:17:00.204516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.204341    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9889645e-b132-40a1-94e0-95dc7a772465" containerName="util"
Sep 09 12:17:00.204516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.204352    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9889645e-b132-40a1-94e0-95dc7a772465" containerName="util"
Sep 09 12:17:00.204516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.204364    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9889645e-b132-40a1-94e0-95dc7a772465" containerName="pull"
Sep 09 12:17:00.204516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.204370    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9889645e-b132-40a1-94e0-95dc7a772465" containerName="pull"
Sep 09 12:17:00.204516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.204383    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9889645e-b132-40a1-94e0-95dc7a772465" containerName="extract"
Sep 09 12:17:00.204516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.204388    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9889645e-b132-40a1-94e0-95dc7a772465" containerName="extract"
Sep 09 12:17:00.204516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.204436    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9889645e-b132-40a1-94e0-95dc7a772465" containerName="extract"
Sep 09 12:17:00.207505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.207489    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"
Sep 09 12:17:00.211212 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.211190    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-86fsk\""
Sep 09 12:17:00.211438 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.211423    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 12:17:00.211525 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.211496    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 12:17:00.227671 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.227640    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"]
Sep 09 12:17:00.270833 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.270792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/069cbc5a-72d1-4ace-b614-5f7baef894aa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xwqdf\" (UID: \"069cbc5a-72d1-4ace-b614-5f7baef894aa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"
Sep 09 12:17:00.270833 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.270828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmgxz\" (UniqueName: \"kubernetes.io/projected/069cbc5a-72d1-4ace-b614-5f7baef894aa-kube-api-access-lmgxz\") pod \"cert-manager-operator-controller-manager-55c444bf86-xwqdf\" (UID: \"069cbc5a-72d1-4ace-b614-5f7baef894aa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"
Sep 09 12:17:00.372070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.372044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/069cbc5a-72d1-4ace-b614-5f7baef894aa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xwqdf\" (UID: \"069cbc5a-72d1-4ace-b614-5f7baef894aa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"
Sep 09 12:17:00.372190 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.372077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmgxz\" (UniqueName: \"kubernetes.io/projected/069cbc5a-72d1-4ace-b614-5f7baef894aa-kube-api-access-lmgxz\") pod \"cert-manager-operator-controller-manager-55c444bf86-xwqdf\" (UID: \"069cbc5a-72d1-4ace-b614-5f7baef894aa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"
Sep 09 12:17:00.372430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.372412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/069cbc5a-72d1-4ace-b614-5f7baef894aa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xwqdf\" (UID: \"069cbc5a-72d1-4ace-b614-5f7baef894aa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"
Sep 09 12:17:00.390589 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.390564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmgxz\" (UniqueName: \"kubernetes.io/projected/069cbc5a-72d1-4ace-b614-5f7baef894aa-kube-api-access-lmgxz\") pod \"cert-manager-operator-controller-manager-55c444bf86-xwqdf\" (UID: \"069cbc5a-72d1-4ace-b614-5f7baef894aa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"
Sep 09 12:17:00.516689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.516609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"
Sep 09 12:17:00.804005 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.803981    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf"]
Sep 09 12:17:00.805724 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:17:00.805692    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069cbc5a_72d1_4ace_b614_5f7baef894aa.slice/crio-4b619adc4c5ee0b6588cebc770dd20cad043b84373f4e789d398df86d156c24f WatchSource:0}: Error finding container 4b619adc4c5ee0b6588cebc770dd20cad043b84373f4e789d398df86d156c24f: Status 404 returned error can't find the container with id 4b619adc4c5ee0b6588cebc770dd20cad043b84373f4e789d398df86d156c24f
Sep 09 12:17:00.826080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:00.826047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf" event={"ID":"069cbc5a-72d1-4ace-b614-5f7baef894aa","Type":"ContainerStarted","Data":"4b619adc4c5ee0b6588cebc770dd20cad043b84373f4e789d398df86d156c24f"}
Sep 09 12:17:01.946825 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:01.946791    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:02.115827 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:02.115790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:03.840353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:03.840318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf" event={"ID":"069cbc5a-72d1-4ace-b614-5f7baef894aa","Type":"ContainerStarted","Data":"f9a29c8c41ff53d4fc1a2d77967b55cec21b675a19e89542534794be5afde59d"}
Sep 09 12:17:03.875096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:03.875039    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xwqdf" podStartSLOduration=1.769759732 podStartE2EDuration="3.87501983s" totalImagesPullingTime="2.105260098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:17:03.873134293 +0000 UTC m=+339.919259471" watchObservedRunningTime="2026-09-09 12:17:03.87501983 +0000 UTC m=+339.921145010"
Sep 09 12:17:03.955128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:03.955092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:04.059750 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.059715    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:04.371622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.371578    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:04.518866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.518830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:04.578455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.578424    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"]
Sep 09 12:17:04.581964 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.581946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.596159 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.596140    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 12:17:04.596159 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.596154    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v5gb7\""
Sep 09 12:17:04.597013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.596998    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 12:17:04.597321 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.597287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.597362 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.597348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvtj\" (UniqueName: \"kubernetes.io/projected/a79713c1-a997-41cb-af65-860c89a08725-kube-api-access-ctvtj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.597396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.597376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.607930 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.607907    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"]
Sep 09 12:17:04.698433 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.698351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.698433 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.698405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvtj\" (UniqueName: \"kubernetes.io/projected/a79713c1-a997-41cb-af65-860c89a08725-kube-api-access-ctvtj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.698656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.698436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.698792 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.698771    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.698855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.698830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.715684 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.715652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvtj\" (UniqueName: \"kubernetes.io/projected/a79713c1-a997-41cb-af65-860c89a08725-kube-api-access-ctvtj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:04.891182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:04.891149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:05.168240 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.168214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"]
Sep 09 12:17:05.170721 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:17:05.170698    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79713c1_a997_41cb_af65_860c89a08725.slice/crio-0333e78b6be1c3e89d381f4c482933c30254e35bfba977d2156938dd2d6d1e94 WatchSource:0}: Error finding container 0333e78b6be1c3e89d381f4c482933c30254e35bfba977d2156938dd2d6d1e94: Status 404 returned error can't find the container with id 0333e78b6be1c3e89d381f4c482933c30254e35bfba977d2156938dd2d6d1e94
Sep 09 12:17:05.624651 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.624617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:05.744371 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.744328    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"]
Sep 09 12:17:05.747602 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.747586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"
Sep 09 12:17:05.750183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.750160    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 12:17:05.750998 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.750984    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rtjlz\""
Sep 09 12:17:05.751057 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.751018    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 12:17:05.760257 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.760235    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"]
Sep 09 12:17:05.808609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.808570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rshjc\" (UniqueName: \"kubernetes.io/projected/038b2bbb-db3d-4c35-a2e6-afcae13e6357-kube-api-access-rshjc\") pod \"cert-manager-cainjector-559cdd8c87-g8f9p\" (UID: \"038b2bbb-db3d-4c35-a2e6-afcae13e6357\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"
Sep 09 12:17:05.808762 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.808615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/038b2bbb-db3d-4c35-a2e6-afcae13e6357-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8f9p\" (UID: \"038b2bbb-db3d-4c35-a2e6-afcae13e6357\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"
Sep 09 12:17:05.849736 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.849703    2560 generic.go:356] "Generic (PLEG): container finished" podID="a79713c1-a997-41cb-af65-860c89a08725" containerID="3b5ac5107da435ad15ad5878ab7e3c6acbced6da1218c58ad85265da9bffd8e8" exitCode=0
Sep 09 12:17:05.849878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.849764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg" event={"ID":"a79713c1-a997-41cb-af65-860c89a08725","Type":"ContainerDied","Data":"3b5ac5107da435ad15ad5878ab7e3c6acbced6da1218c58ad85265da9bffd8e8"}
Sep 09 12:17:05.849878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.849804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg" event={"ID":"a79713c1-a997-41cb-af65-860c89a08725","Type":"ContainerStarted","Data":"0333e78b6be1c3e89d381f4c482933c30254e35bfba977d2156938dd2d6d1e94"}
Sep 09 12:17:05.909078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.909001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rshjc\" (UniqueName: \"kubernetes.io/projected/038b2bbb-db3d-4c35-a2e6-afcae13e6357-kube-api-access-rshjc\") pod \"cert-manager-cainjector-559cdd8c87-g8f9p\" (UID: \"038b2bbb-db3d-4c35-a2e6-afcae13e6357\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"
Sep 09 12:17:05.909078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.909038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/038b2bbb-db3d-4c35-a2e6-afcae13e6357-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8f9p\" (UID: \"038b2bbb-db3d-4c35-a2e6-afcae13e6357\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"
Sep 09 12:17:05.922908 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.922877    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rshjc\" (UniqueName: \"kubernetes.io/projected/038b2bbb-db3d-4c35-a2e6-afcae13e6357-kube-api-access-rshjc\") pod \"cert-manager-cainjector-559cdd8c87-g8f9p\" (UID: \"038b2bbb-db3d-4c35-a2e6-afcae13e6357\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"
Sep 09 12:17:05.923102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:05.923082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/038b2bbb-db3d-4c35-a2e6-afcae13e6357-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8f9p\" (UID: \"038b2bbb-db3d-4c35-a2e6-afcae13e6357\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"
Sep 09 12:17:06.079507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:06.079473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"
Sep 09 12:17:06.142521 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:06.142491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:06.354806 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:06.354780    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p"]
Sep 09 12:17:06.357451 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:17:06.357415    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod038b2bbb_db3d_4c35_a2e6_afcae13e6357.slice/crio-8b9619bae4357e9c771d9695d888393e0856e2c538183957081490ea47a15075 WatchSource:0}: Error finding container 8b9619bae4357e9c771d9695d888393e0856e2c538183957081490ea47a15075: Status 404 returned error can't find the container with id 8b9619bae4357e9c771d9695d888393e0856e2c538183957081490ea47a15075
Sep 09 12:17:06.855007 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:06.854972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p" event={"ID":"038b2bbb-db3d-4c35-a2e6-afcae13e6357","Type":"ContainerStarted","Data":"8b9619bae4357e9c771d9695d888393e0856e2c538183957081490ea47a15075"}
Sep 09 12:17:08.059160 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:08.059118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:08.159657 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:08.159614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:08.867224 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:08.867184    2560 generic.go:356] "Generic (PLEG): container finished" podID="a79713c1-a997-41cb-af65-860c89a08725" containerID="de4d13bbfd6d281e351a8ae208cc6880aa052f69dcde9f672dd522127a30169d" exitCode=0
Sep 09 12:17:08.867438 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:08.867277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg" event={"ID":"a79713c1-a997-41cb-af65-860c89a08725","Type":"ContainerDied","Data":"de4d13bbfd6d281e351a8ae208cc6880aa052f69dcde9f672dd522127a30169d"}
Sep 09 12:17:09.873308 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:09.873255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg" event={"ID":"a79713c1-a997-41cb-af65-860c89a08725","Type":"ContainerStarted","Data":"b3cb06a84116fe6129c2ddbdf08591b84c1bba816a6cd2d0ccddb8749dbb4753"}
Sep 09 12:17:09.895682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:09.895629    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg" podStartSLOduration=3.267228616 podStartE2EDuration="5.895613626s" totalImagesPullingTime="2.62838501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:17:09.893898499 +0000 UTC m=+345.940023677" watchObservedRunningTime="2026-09-09 12:17:09.895613626 +0000 UTC m=+345.941738803"
Sep 09 12:17:10.879790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:10.879761    2560 generic.go:356] "Generic (PLEG): container finished" podID="a79713c1-a997-41cb-af65-860c89a08725" containerID="b3cb06a84116fe6129c2ddbdf08591b84c1bba816a6cd2d0ccddb8749dbb4753" exitCode=0
Sep 09 12:17:10.880231 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:10.879848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg" event={"ID":"a79713c1-a997-41cb-af65-860c89a08725","Type":"ContainerDied","Data":"b3cb06a84116fe6129c2ddbdf08591b84c1bba816a6cd2d0ccddb8749dbb4753"}
Sep 09 12:17:10.881375 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:10.881355    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p" event={"ID":"038b2bbb-db3d-4c35-a2e6-afcae13e6357","Type":"ContainerStarted","Data":"9d9d1f6d7a1786d56062ff30fd2f0087b5f3d0a8c10b6254f16198ef04de7160"}
Sep 09 12:17:10.955751 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:10.955697    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8f9p" podStartSLOduration=1.997330812 podStartE2EDuration="5.955684296s" totalImagesPullingTime="3.958353484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:17:10.954443327 +0000 UTC m=+347.000568504" watchObservedRunningTime="2026-09-09 12:17:10.955684296 +0000 UTC m=+347.001809474"
Sep 09 12:17:12.034648 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.034609    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:12.060506 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.060476    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctvtj\" (UniqueName: \"kubernetes.io/projected/a79713c1-a997-41cb-af65-860c89a08725-kube-api-access-ctvtj\") pod \"a79713c1-a997-41cb-af65-860c89a08725\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") "
Sep 09 12:17:12.060676 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.060524    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-bundle\") pod \"a79713c1-a997-41cb-af65-860c89a08725\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") "
Sep 09 12:17:12.060676 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.060576    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-util\") pod \"a79713c1-a997-41cb-af65-860c89a08725\" (UID: \"a79713c1-a997-41cb-af65-860c89a08725\") "
Sep 09 12:17:12.060953 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.060928    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-bundle" (OuterVolumeSpecName: "bundle") pod "a79713c1-a997-41cb-af65-860c89a08725" (UID: "a79713c1-a997-41cb-af65-860c89a08725"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:17:12.062683 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.062649    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79713c1-a997-41cb-af65-860c89a08725-kube-api-access-ctvtj" (OuterVolumeSpecName: "kube-api-access-ctvtj") pod "a79713c1-a997-41cb-af65-860c89a08725" (UID: "a79713c1-a997-41cb-af65-860c89a08725"). InnerVolumeSpecName "kube-api-access-ctvtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:17:12.065360 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.065322    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-util" (OuterVolumeSpecName: "util") pod "a79713c1-a997-41cb-af65-860c89a08725" (UID: "a79713c1-a997-41cb-af65-860c89a08725"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:17:12.161945 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.161859    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctvtj\" (UniqueName: \"kubernetes.io/projected/a79713c1-a997-41cb-af65-860c89a08725-kube-api-access-ctvtj\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:12.161945 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.161896    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:12.161945 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.161908    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a79713c1-a997-41cb-af65-860c89a08725-util\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:12.891473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.891432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg" event={"ID":"a79713c1-a997-41cb-af65-860c89a08725","Type":"ContainerDied","Data":"0333e78b6be1c3e89d381f4c482933c30254e35bfba977d2156938dd2d6d1e94"}
Sep 09 12:17:12.891473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.891475    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqgzvg"
Sep 09 12:17:12.891682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:12.891479    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0333e78b6be1c3e89d381f4c482933c30254e35bfba977d2156938dd2d6d1e94"
Sep 09 12:17:14.402595 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:14.402553    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:15.522439 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:15.522399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:15.613284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:15.613247    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:21.159933 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:21.159845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:21.259535 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:21.259497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:21.531807 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:21.531712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:22.948510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.948476    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"]
Sep 09 12:17:22.948898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.948748    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79713c1-a997-41cb-af65-860c89a08725" containerName="extract"
Sep 09 12:17:22.948898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.948760    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79713c1-a997-41cb-af65-860c89a08725" containerName="extract"
Sep 09 12:17:22.948898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.948771    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79713c1-a997-41cb-af65-860c89a08725" containerName="pull"
Sep 09 12:17:22.948898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.948776    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79713c1-a997-41cb-af65-860c89a08725" containerName="pull"
Sep 09 12:17:22.948898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.948791    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79713c1-a997-41cb-af65-860c89a08725" containerName="util"
Sep 09 12:17:22.948898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.948796    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79713c1-a997-41cb-af65-860c89a08725" containerName="util"
Sep 09 12:17:22.948898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.948853    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79713c1-a997-41cb-af65-860c89a08725" containerName="extract"
Sep 09 12:17:22.950903 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.950887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:22.953690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.953669    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 12:17:22.954227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.954188    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v5gb7\""
Sep 09 12:17:22.954784 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.954758    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 12:17:22.964592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:22.964571    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"]
Sep 09 12:17:23.031771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.031734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:23.044808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.044783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.044931 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.044838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.044931 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.044890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfrpp\" (UniqueName: \"kubernetes.io/projected/70c45f4b-1add-4e75-8916-03bc0483fb31-kube-api-access-kfrpp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.145809 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.145775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.145809 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.145808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfrpp\" (UniqueName: \"kubernetes.io/projected/70c45f4b-1add-4e75-8916-03bc0483fb31-kube-api-access-kfrpp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.146036 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.145844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.146253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.146234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.146401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.146257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.156002 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.155974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfrpp\" (UniqueName: \"kubernetes.io/projected/70c45f4b-1add-4e75-8916-03bc0483fb31-kube-api-access-kfrpp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.262946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.262866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:23.534510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.534484    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"]
Sep 09 12:17:23.536598 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:17:23.536574    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c45f4b_1add_4e75_8916_03bc0483fb31.slice/crio-c59ef42075b0354d9d990887b9ac064976445d9a27dfc11226d9806717be26e1 WatchSource:0}: Error finding container c59ef42075b0354d9d990887b9ac064976445d9a27dfc11226d9806717be26e1: Status 404 returned error can't find the container with id c59ef42075b0354d9d990887b9ac064976445d9a27dfc11226d9806717be26e1
Sep 09 12:17:23.937676 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.937636    2560 generic.go:356] "Generic (PLEG): container finished" podID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerID="d0e8c7c355229165c321fd2494175952a8450b36a38c01109becd4710b031201" exitCode=0
Sep 09 12:17:23.937877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.937712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf" event={"ID":"70c45f4b-1add-4e75-8916-03bc0483fb31","Type":"ContainerDied","Data":"d0e8c7c355229165c321fd2494175952a8450b36a38c01109becd4710b031201"}
Sep 09 12:17:23.937877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:23.937751    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf" event={"ID":"70c45f4b-1add-4e75-8916-03bc0483fb31","Type":"ContainerStarted","Data":"c59ef42075b0354d9d990887b9ac064976445d9a27dfc11226d9806717be26e1"}
Sep 09 12:17:24.158752 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.158718    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mbtmp"]
Sep 09 12:17:24.161624 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.161605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mbtmp"
Sep 09 12:17:24.164031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.164011    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c4qcb\""
Sep 09 12:17:24.180662 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.180639    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mbtmp"]
Sep 09 12:17:24.254454 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.254381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6r58\" (UniqueName: \"kubernetes.io/projected/8f953e44-5337-4768-baec-5ede31180963-kube-api-access-j6r58\") pod \"cert-manager-55b4d954d5-mbtmp\" (UID: \"8f953e44-5337-4768-baec-5ede31180963\") " pod="cert-manager/cert-manager-55b4d954d5-mbtmp"
Sep 09 12:17:24.254454 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.254430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f953e44-5337-4768-baec-5ede31180963-bound-sa-token\") pod \"cert-manager-55b4d954d5-mbtmp\" (UID: \"8f953e44-5337-4768-baec-5ede31180963\") " pod="cert-manager/cert-manager-55b4d954d5-mbtmp"
Sep 09 12:17:24.354870 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.354844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6r58\" (UniqueName: \"kubernetes.io/projected/8f953e44-5337-4768-baec-5ede31180963-kube-api-access-j6r58\") pod \"cert-manager-55b4d954d5-mbtmp\" (UID: \"8f953e44-5337-4768-baec-5ede31180963\") " pod="cert-manager/cert-manager-55b4d954d5-mbtmp"
Sep 09 12:17:24.355011 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.354888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f953e44-5337-4768-baec-5ede31180963-bound-sa-token\") pod \"cert-manager-55b4d954d5-mbtmp\" (UID: \"8f953e44-5337-4768-baec-5ede31180963\") " pod="cert-manager/cert-manager-55b4d954d5-mbtmp"
Sep 09 12:17:24.364703 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.364674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f953e44-5337-4768-baec-5ede31180963-bound-sa-token\") pod \"cert-manager-55b4d954d5-mbtmp\" (UID: \"8f953e44-5337-4768-baec-5ede31180963\") " pod="cert-manager/cert-manager-55b4d954d5-mbtmp"
Sep 09 12:17:24.364849 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.364827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6r58\" (UniqueName: \"kubernetes.io/projected/8f953e44-5337-4768-baec-5ede31180963-kube-api-access-j6r58\") pod \"cert-manager-55b4d954d5-mbtmp\" (UID: \"8f953e44-5337-4768-baec-5ede31180963\") " pod="cert-manager/cert-manager-55b4d954d5-mbtmp"
Sep 09 12:17:24.475092 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.475058    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c4qcb\""
Sep 09 12:17:24.479579 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.479562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mbtmp"
Sep 09 12:17:24.765466 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.765443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mbtmp"]
Sep 09 12:17:24.768702 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:17:24.768676    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f953e44_5337_4768_baec_5ede31180963.slice/crio-ad3b22b528207b2dea307a3083f89b168d82156c846a2441b1a12ce5dec9a2e4 WatchSource:0}: Error finding container ad3b22b528207b2dea307a3083f89b168d82156c846a2441b1a12ce5dec9a2e4: Status 404 returned error can't find the container with id ad3b22b528207b2dea307a3083f89b168d82156c846a2441b1a12ce5dec9a2e4
Sep 09 12:17:24.943612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.943579    2560 generic.go:356] "Generic (PLEG): container finished" podID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerID="0f94dae00822d5e0323866ed2ec03dcafd6a995e58a8fd2a2b1b7268636db517" exitCode=0
Sep 09 12:17:24.943789 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.943662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf" event={"ID":"70c45f4b-1add-4e75-8916-03bc0483fb31","Type":"ContainerDied","Data":"0f94dae00822d5e0323866ed2ec03dcafd6a995e58a8fd2a2b1b7268636db517"}
Sep 09 12:17:24.945350 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.945324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mbtmp" event={"ID":"8f953e44-5337-4768-baec-5ede31180963","Type":"ContainerStarted","Data":"92d766f785ddd8c35b2db3ddf631e30604b87a20c573dc956e6ef4454bdcc1f4"}
Sep 09 12:17:24.945447 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.945362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mbtmp" event={"ID":"8f953e44-5337-4768-baec-5ede31180963","Type":"ContainerStarted","Data":"ad3b22b528207b2dea307a3083f89b168d82156c846a2441b1a12ce5dec9a2e4"}
Sep 09 12:17:24.977212 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:24.977159    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mbtmp" podStartSLOduration=0.977139081 podStartE2EDuration="977.139081ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:17:24.976947746 +0000 UTC m=+361.023072925" watchObservedRunningTime="2026-09-09 12:17:24.977139081 +0000 UTC m=+361.023264262"
Sep 09 12:17:25.952150 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:25.952110    2560 generic.go:356] "Generic (PLEG): container finished" podID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerID="5ee1f706056798fb5badd8ef8d80355a3066b6958f848e40fde96be6ec3f2e60" exitCode=0
Sep 09 12:17:25.952584 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:25.952195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf" event={"ID":"70c45f4b-1add-4e75-8916-03bc0483fb31","Type":"ContainerDied","Data":"5ee1f706056798fb5badd8ef8d80355a3066b6958f848e40fde96be6ec3f2e60"}
Sep 09 12:17:27.075463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.075440    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:27.180305 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.180268    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-bundle\") pod \"70c45f4b-1add-4e75-8916-03bc0483fb31\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") "
Sep 09 12:17:27.180466 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.180336    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-util\") pod \"70c45f4b-1add-4e75-8916-03bc0483fb31\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") "
Sep 09 12:17:27.180466 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.180393    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfrpp\" (UniqueName: \"kubernetes.io/projected/70c45f4b-1add-4e75-8916-03bc0483fb31-kube-api-access-kfrpp\") pod \"70c45f4b-1add-4e75-8916-03bc0483fb31\" (UID: \"70c45f4b-1add-4e75-8916-03bc0483fb31\") "
Sep 09 12:17:27.180994 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.180956    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-bundle" (OuterVolumeSpecName: "bundle") pod "70c45f4b-1add-4e75-8916-03bc0483fb31" (UID: "70c45f4b-1add-4e75-8916-03bc0483fb31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:17:27.182446 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.182417    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70c45f4b-1add-4e75-8916-03bc0483fb31-kube-api-access-kfrpp" (OuterVolumeSpecName: "kube-api-access-kfrpp") pod "70c45f4b-1add-4e75-8916-03bc0483fb31" (UID: "70c45f4b-1add-4e75-8916-03bc0483fb31"). InnerVolumeSpecName "kube-api-access-kfrpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:17:27.185850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.185826    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-util" (OuterVolumeSpecName: "util") pod "70c45f4b-1add-4e75-8916-03bc0483fb31" (UID: "70c45f4b-1add-4e75-8916-03bc0483fb31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:17:27.281364 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.281253    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfrpp\" (UniqueName: \"kubernetes.io/projected/70c45f4b-1add-4e75-8916-03bc0483fb31-kube-api-access-kfrpp\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:27.281364 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.281309    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:27.281364 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.281325    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70c45f4b-1add-4e75-8916-03bc0483fb31-util\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:27.963660 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.963630    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf"
Sep 09 12:17:27.963829 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.963631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj29jf" event={"ID":"70c45f4b-1add-4e75-8916-03bc0483fb31","Type":"ContainerDied","Data":"c59ef42075b0354d9d990887b9ac064976445d9a27dfc11226d9806717be26e1"}
Sep 09 12:17:27.963829 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:27.963747    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c59ef42075b0354d9d990887b9ac064976445d9a27dfc11226d9806717be26e1"
Sep 09 12:17:38.734474 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:38.734424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:38.952207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:38.952167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:39.051450 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:39.051357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:39.535343 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:39.535310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:39.899046 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:39.899013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:40.044712 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.044683    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"]
Sep 09 12:17:40.044983 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.044970    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerName="extract"
Sep 09 12:17:40.045026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.044985    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerName="extract"
Sep 09 12:17:40.045026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.045004    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerName="pull"
Sep 09 12:17:40.045026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.045010    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerName="pull"
Sep 09 12:17:40.045026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.045020    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerName="util"
Sep 09 12:17:40.045026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.045025    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerName="util"
Sep 09 12:17:40.045174 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.045075    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c45f4b-1add-4e75-8916-03bc0483fb31" containerName="extract"
Sep 09 12:17:40.047991 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.047975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.051349 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.051326    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 12:17:40.051467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.051367    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 12:17:40.051537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.051509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ssn29\""
Sep 09 12:17:40.051599 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.051535    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 12:17:40.051599 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.051558    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 12:17:40.069411 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.069388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"]
Sep 09 12:17:40.177382 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.177284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:40.181286 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.181266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz6pq\" (UniqueName: \"kubernetes.io/projected/acd2a377-813d-41eb-8680-4ee6db3c575a-kube-api-access-dz6pq\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.181365 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.181349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acd2a377-813d-41eb-8680-4ee6db3c575a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.181403 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.181376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acd2a377-813d-41eb-8680-4ee6db3c575a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.181443 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.181408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acd2a377-813d-41eb-8680-4ee6db3c575a-manifests\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.181443 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.181435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd2a377-813d-41eb-8680-4ee6db3c575a-tmp\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.271859 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.271827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:40.282839 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.282813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz6pq\" (UniqueName: \"kubernetes.io/projected/acd2a377-813d-41eb-8680-4ee6db3c575a-kube-api-access-dz6pq\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.282915 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.282851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acd2a377-813d-41eb-8680-4ee6db3c575a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.282915 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.282869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acd2a377-813d-41eb-8680-4ee6db3c575a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.282915 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.282894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acd2a377-813d-41eb-8680-4ee6db3c575a-manifests\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.283025 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.282915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd2a377-813d-41eb-8680-4ee6db3c575a-tmp\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.283407 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.283384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/acd2a377-813d-41eb-8680-4ee6db3c575a-manifests\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.285213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.285182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd2a377-813d-41eb-8680-4ee6db3c575a-tmp\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.285355 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.285243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acd2a377-813d-41eb-8680-4ee6db3c575a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.285355 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.285263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/acd2a377-813d-41eb-8680-4ee6db3c575a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.293904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.293883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz6pq\" (UniqueName: \"kubernetes.io/projected/acd2a377-813d-41eb-8680-4ee6db3c575a-kube-api-access-dz6pq\") pod \"opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9\" (UID: \"acd2a377-813d-41eb-8680-4ee6db3c575a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.324553 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.324526    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"]
Sep 09 12:17:40.326896 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.326881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.329882 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.329865    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 12:17:40.330003 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.329918    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 12:17:40.330003 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.329965    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v5gb7\""
Sep 09 12:17:40.338609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.338583    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"]
Sep 09 12:17:40.357792 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.357765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:40.384268 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.384239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.384268 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.384273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.384475 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.384326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hntcz\" (UniqueName: \"kubernetes.io/projected/49706af4-09b3-4100-b75c-e70912310d5b-kube-api-access-hntcz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.484904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.484821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hntcz\" (UniqueName: \"kubernetes.io/projected/49706af4-09b3-4100-b75c-e70912310d5b-kube-api-access-hntcz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.485072 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.484915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.485072 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.484946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.485376 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.485355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.485462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.485385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.490748 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.490710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:40.496774 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.496749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hntcz\" (UniqueName: \"kubernetes.io/projected/49706af4-09b3-4100-b75c-e70912310d5b-kube-api-access-hntcz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.593266 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.593228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:40.636679 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.635967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:40.637696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.637674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"]
Sep 09 12:17:40.641013 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:17:40.640993    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd2a377_813d_41eb_8680_4ee6db3c575a.slice/crio-a4b4d9e9af36be01be6726b2f0d42f787c28065429535b613f2fb1107538e218 WatchSource:0}: Error finding container a4b4d9e9af36be01be6726b2f0d42f787c28065429535b613f2fb1107538e218: Status 404 returned error can't find the container with id a4b4d9e9af36be01be6726b2f0d42f787c28065429535b613f2fb1107538e218
Sep 09 12:17:40.692465 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.692368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:40.922802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:40.922773    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"]
Sep 09 12:17:40.925715 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:17:40.925687    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49706af4_09b3_4100_b75c_e70912310d5b.slice/crio-7310af3b7ed6d379b790305dbeb1f818bec8dceaf6f13ec4fee388b40f71a1a3 WatchSource:0}: Error finding container 7310af3b7ed6d379b790305dbeb1f818bec8dceaf6f13ec4fee388b40f71a1a3: Status 404 returned error can't find the container with id 7310af3b7ed6d379b790305dbeb1f818bec8dceaf6f13ec4fee388b40f71a1a3
Sep 09 12:17:41.022571 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:41.022539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld" event={"ID":"49706af4-09b3-4100-b75c-e70912310d5b","Type":"ContainerStarted","Data":"231ab29e178d79185dbc49e60311435ef21baa3554a13d1b9f6fa1c37771abf5"}
Sep 09 12:17:41.022736 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:41.022592    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld" event={"ID":"49706af4-09b3-4100-b75c-e70912310d5b","Type":"ContainerStarted","Data":"7310af3b7ed6d379b790305dbeb1f818bec8dceaf6f13ec4fee388b40f71a1a3"}
Sep 09 12:17:41.024326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:41.024288    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9" event={"ID":"acd2a377-813d-41eb-8680-4ee6db3c575a","Type":"ContainerStarted","Data":"a4b4d9e9af36be01be6726b2f0d42f787c28065429535b613f2fb1107538e218"}
Sep 09 12:17:42.034144 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:42.034060    2560 generic.go:356] "Generic (PLEG): container finished" podID="49706af4-09b3-4100-b75c-e70912310d5b" containerID="231ab29e178d79185dbc49e60311435ef21baa3554a13d1b9f6fa1c37771abf5" exitCode=0
Sep 09 12:17:42.034144 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:42.034094    2560 generic.go:356] "Generic (PLEG): container finished" podID="49706af4-09b3-4100-b75c-e70912310d5b" containerID="5d73149f9b3222100277c5cb4555cab87415e4090b1d50569d85fa4a8ab3ce12" exitCode=0
Sep 09 12:17:42.034672 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:42.034143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld" event={"ID":"49706af4-09b3-4100-b75c-e70912310d5b","Type":"ContainerDied","Data":"231ab29e178d79185dbc49e60311435ef21baa3554a13d1b9f6fa1c37771abf5"}
Sep 09 12:17:42.034672 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:42.034206    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld" event={"ID":"49706af4-09b3-4100-b75c-e70912310d5b","Type":"ContainerDied","Data":"5d73149f9b3222100277c5cb4555cab87415e4090b1d50569d85fa4a8ab3ce12"}
Sep 09 12:17:44.046608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:44.046528    2560 generic.go:356] "Generic (PLEG): container finished" podID="49706af4-09b3-4100-b75c-e70912310d5b" containerID="e3c49df4bc6d2de6c29202cb323f3b9e22f8d13880366de78f1a5c42397b3327" exitCode=0
Sep 09 12:17:44.046967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:44.046618    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld" event={"ID":"49706af4-09b3-4100-b75c-e70912310d5b","Type":"ContainerDied","Data":"e3c49df4bc6d2de6c29202cb323f3b9e22f8d13880366de78f1a5c42397b3327"}
Sep 09 12:17:44.048207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:44.048183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9" event={"ID":"acd2a377-813d-41eb-8680-4ee6db3c575a","Type":"ContainerStarted","Data":"538e8eae9316c53518dd8c8029b94a486aad79b28ac529204c5d55dffbd23bd0"}
Sep 09 12:17:45.055001 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.054960    2560 generic.go:356] "Generic (PLEG): container finished" podID="acd2a377-813d-41eb-8680-4ee6db3c575a" containerID="538e8eae9316c53518dd8c8029b94a486aad79b28ac529204c5d55dffbd23bd0" exitCode=0
Sep 09 12:17:45.055481 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.055076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9" event={"ID":"acd2a377-813d-41eb-8680-4ee6db3c575a","Type":"ContainerDied","Data":"538e8eae9316c53518dd8c8029b94a486aad79b28ac529204c5d55dffbd23bd0"}
Sep 09 12:17:45.176960 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.176939    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:45.326459 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.326432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hntcz\" (UniqueName: \"kubernetes.io/projected/49706af4-09b3-4100-b75c-e70912310d5b-kube-api-access-hntcz\") pod \"49706af4-09b3-4100-b75c-e70912310d5b\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") "
Sep 09 12:17:45.326611 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.326475    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-bundle\") pod \"49706af4-09b3-4100-b75c-e70912310d5b\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") "
Sep 09 12:17:45.326611 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.326495    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-util\") pod \"49706af4-09b3-4100-b75c-e70912310d5b\" (UID: \"49706af4-09b3-4100-b75c-e70912310d5b\") "
Sep 09 12:17:45.327228 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.327200    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-bundle" (OuterVolumeSpecName: "bundle") pod "49706af4-09b3-4100-b75c-e70912310d5b" (UID: "49706af4-09b3-4100-b75c-e70912310d5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:17:45.328549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.328515    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49706af4-09b3-4100-b75c-e70912310d5b-kube-api-access-hntcz" (OuterVolumeSpecName: "kube-api-access-hntcz") pod "49706af4-09b3-4100-b75c-e70912310d5b" (UID: "49706af4-09b3-4100-b75c-e70912310d5b"). InnerVolumeSpecName "kube-api-access-hntcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:17:45.332573 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.332551    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-util" (OuterVolumeSpecName: "util") pod "49706af4-09b3-4100-b75c-e70912310d5b" (UID: "49706af4-09b3-4100-b75c-e70912310d5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:17:45.426939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.426905    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:45.426939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.426931    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49706af4-09b3-4100-b75c-e70912310d5b-util\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:45.426939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:45.426940    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hntcz\" (UniqueName: \"kubernetes.io/projected/49706af4-09b3-4100-b75c-e70912310d5b-kube-api-access-hntcz\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:17:46.061690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:46.061654    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9" event={"ID":"acd2a377-813d-41eb-8680-4ee6db3c575a","Type":"ContainerStarted","Data":"2d4cf78c3ab5cf546d25b0fffef3dc5f03155933d723117a1f2da8034fba37c9"}
Sep 09 12:17:46.062177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:46.061770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:46.063719 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:46.063686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld" event={"ID":"49706af4-09b3-4100-b75c-e70912310d5b","Type":"ContainerDied","Data":"7310af3b7ed6d379b790305dbeb1f818bec8dceaf6f13ec4fee388b40f71a1a3"}
Sep 09 12:17:46.063719 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:46.063721    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7310af3b7ed6d379b790305dbeb1f818bec8dceaf6f13ec4fee388b40f71a1a3"
Sep 09 12:17:46.063905 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:46.063726    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rvbld"
Sep 09 12:17:46.086272 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:46.086220    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9" podStartSLOduration=1.437363225 podStartE2EDuration="6.086207142s" totalImagesPullingTime="3.56345689s" totalInitContainerRuntime="1.085387027s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:17:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:17:46.083556617 +0000 UTC m=+382.129681796" watchObservedRunningTime="2026-09-09 12:17:46.086207142 +0000 UTC m=+382.132332319"
Sep 09 12:17:47.737727 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:47.737688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:47.822546 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:47.822503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:49.517307 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:49.517260    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f65d7cd4c-tktjq"]
Sep 09 12:17:49.701115 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:49.701075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:49.880131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:49.880100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:55.647116 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:55.647076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:55.748029 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:55.747994    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:56.080177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:56.080144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:56.145882 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:56.145846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:57.070786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:57.070756    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9"
Sep 09 12:17:59.457491 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:59.457448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:17:59.594648 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:17:59.594611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:05.094732 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.094687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:05.114560 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.114527    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"]
Sep 09 12:18:05.114840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.114827    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49706af4-09b3-4100-b75c-e70912310d5b" containerName="util"
Sep 09 12:18:05.114883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.114842    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="49706af4-09b3-4100-b75c-e70912310d5b" containerName="util"
Sep 09 12:18:05.114883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.114861    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49706af4-09b3-4100-b75c-e70912310d5b" containerName="extract"
Sep 09 12:18:05.114883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.114868    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="49706af4-09b3-4100-b75c-e70912310d5b" containerName="extract"
Sep 09 12:18:05.114883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.114881    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49706af4-09b3-4100-b75c-e70912310d5b" containerName="pull"
Sep 09 12:18:05.115002 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.114887    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="49706af4-09b3-4100-b75c-e70912310d5b" containerName="pull"
Sep 09 12:18:05.115002 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.114948    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="49706af4-09b3-4100-b75c-e70912310d5b" containerName="extract"
Sep 09 12:18:05.121754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.121734    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.128362 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.128323    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 12:18:05.128522 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.128372    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 12:18:05.128522 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.128389    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 12:18:05.129210 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.129191    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 12:18:05.129354 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.129261    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zs2nq\""
Sep 09 12:18:05.140832 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.140810    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"]
Sep 09 12:18:05.291152 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.291123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckkhq\" (UniqueName: \"kubernetes.io/projected/74833e63-8bd7-4680-a5b2-f6917bb2636e-kube-api-access-ckkhq\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.291332 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.291160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74833e63-8bd7-4680-a5b2-f6917bb2636e-tls-certs\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.291332 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.291180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74833e63-8bd7-4680-a5b2-f6917bb2636e-tmp\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.327430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.327387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:05.391906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.391831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74833e63-8bd7-4680-a5b2-f6917bb2636e-tls-certs\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.391906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.391867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74833e63-8bd7-4680-a5b2-f6917bb2636e-tmp\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.392099 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.391924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckkhq\" (UniqueName: \"kubernetes.io/projected/74833e63-8bd7-4680-a5b2-f6917bb2636e-kube-api-access-ckkhq\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.394161 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.394136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74833e63-8bd7-4680-a5b2-f6917bb2636e-tmp\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.394424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.394405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74833e63-8bd7-4680-a5b2-f6917bb2636e-tls-certs\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.401627 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.401607    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckkhq\" (UniqueName: \"kubernetes.io/projected/74833e63-8bd7-4680-a5b2-f6917bb2636e-kube-api-access-ckkhq\") pod \"kube-auth-proxy-9b9df8cfb-9dbml\" (UID: \"74833e63-8bd7-4680-a5b2-f6917bb2636e\") " pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.437160 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.437132    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"
Sep 09 12:18:05.711737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:05.711712    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml"]
Sep 09 12:18:05.713839 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:18:05.713810    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74833e63_8bd7_4680_a5b2_f6917bb2636e.slice/crio-130dd6f90235cf4ffc097b7405f9ef1df80b6bb485ae8c1bced4c789fd71846e WatchSource:0}: Error finding container 130dd6f90235cf4ffc097b7405f9ef1df80b6bb485ae8c1bced4c789fd71846e: Status 404 returned error can't find the container with id 130dd6f90235cf4ffc097b7405f9ef1df80b6bb485ae8c1bced4c789fd71846e
Sep 09 12:18:06.160729 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:06.160693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml" event={"ID":"74833e63-8bd7-4680-a5b2-f6917bb2636e","Type":"ContainerStarted","Data":"130dd6f90235cf4ffc097b7405f9ef1df80b6bb485ae8c1bced4c789fd71846e"}
Sep 09 12:18:06.409603 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:06.409575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:06.543457 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:06.543354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:07.565167 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:07.565133    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:09.180427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:09.180331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml" event={"ID":"74833e63-8bd7-4680-a5b2-f6917bb2636e","Type":"ContainerStarted","Data":"09bd83b128dc279628698340f4b6ff514959e5dd6c9373f7dd903abf28e1161d"}
Sep 09 12:18:09.199703 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:09.199660    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9b9df8cfb-9dbml" podStartSLOduration=1.090195137 podStartE2EDuration="4.199645549s" totalImagesPullingTime="3.109450412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:18:09.197602131 +0000 UTC m=+405.243727308" watchObservedRunningTime="2026-09-09 12:18:09.199645549 +0000 UTC m=+405.245770727"
Sep 09 12:18:10.540089 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.540048    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pq4zx"]
Sep 09 12:18:10.544612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.544589    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:10.547124 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.547104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 12:18:10.547234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.547123    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4ggzv\""
Sep 09 12:18:10.552234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.551872    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pq4zx"]
Sep 09 12:18:10.599715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.599676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:10.698394 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.698366    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:10.740707 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.740674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znls8\" (UniqueName: \"kubernetes.io/projected/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-kube-api-access-znls8\") pod \"odh-model-controller-7998c67dc4-pq4zx\" (UID: \"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:10.740826 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.740728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-cert\") pod \"odh-model-controller-7998c67dc4-pq4zx\" (UID: \"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:10.798688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.798595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:10.841804 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.841771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-cert\") pod \"odh-model-controller-7998c67dc4-pq4zx\" (UID: \"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:10.841953 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.841877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znls8\" (UniqueName: \"kubernetes.io/projected/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-kube-api-access-znls8\") pod \"odh-model-controller-7998c67dc4-pq4zx\" (UID: \"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:10.841953 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:18:10.841937    2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 12:18:10.842029 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:18:10.842013    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-cert podName:8ceb3c3e-f9cd-4c94-af97-d4126d0fac34 nodeName:}" failed. No retries permitted until 2026-09-09 12:18:11.341989735 +0000 UTC m=+407.388114896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-cert") pod "odh-model-controller-7998c67dc4-pq4zx" (UID: "8ceb3c3e-f9cd-4c94-af97-d4126d0fac34") : secret "odh-model-controller-webhook-cert" not found
Sep 09 12:18:10.853328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:10.853282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znls8\" (UniqueName: \"kubernetes.io/projected/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-kube-api-access-znls8\") pod \"odh-model-controller-7998c67dc4-pq4zx\" (UID: \"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:11.059375 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.059339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:11.123906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.123878    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cs2b4"]
Sep 09 12:18:11.127436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.127417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:11.130178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.130159    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 12:18:11.143847 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.143805    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cs2b4"]
Sep 09 12:18:11.147112 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.147086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:11.245969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.245928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhsm2\" (UniqueName: \"kubernetes.io/projected/adf25063-9bb0-4520-a435-3519468d73a9-kube-api-access-zhsm2\") pod \"model-serving-api-54d89bd5fc-cs2b4\" (UID: \"adf25063-9bb0-4520-a435-3519468d73a9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:11.246137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.246039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf25063-9bb0-4520-a435-3519468d73a9-tls-certs\") pod \"model-serving-api-54d89bd5fc-cs2b4\" (UID: \"adf25063-9bb0-4520-a435-3519468d73a9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:11.255925 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.255891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:11.347074 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.346975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-cert\") pod \"odh-model-controller-7998c67dc4-pq4zx\" (UID: \"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:11.347074 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.347044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf25063-9bb0-4520-a435-3519468d73a9-tls-certs\") pod \"model-serving-api-54d89bd5fc-cs2b4\" (UID: \"adf25063-9bb0-4520-a435-3519468d73a9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:11.347308 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.347130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhsm2\" (UniqueName: \"kubernetes.io/projected/adf25063-9bb0-4520-a435-3519468d73a9-kube-api-access-zhsm2\") pod \"model-serving-api-54d89bd5fc-cs2b4\" (UID: \"adf25063-9bb0-4520-a435-3519468d73a9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:11.349528 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.349496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ceb3c3e-f9cd-4c94-af97-d4126d0fac34-cert\") pod \"odh-model-controller-7998c67dc4-pq4zx\" (UID: \"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:11.349637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.349582    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf25063-9bb0-4520-a435-3519468d73a9-tls-certs\") pod \"model-serving-api-54d89bd5fc-cs2b4\" (UID: \"adf25063-9bb0-4520-a435-3519468d73a9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:11.356795 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.356769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhsm2\" (UniqueName: \"kubernetes.io/projected/adf25063-9bb0-4520-a435-3519468d73a9-kube-api-access-zhsm2\") pod \"model-serving-api-54d89bd5fc-cs2b4\" (UID: \"adf25063-9bb0-4520-a435-3519468d73a9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:11.443418 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.443376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:11.457625 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.457592    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:11.718545 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.718336    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cs2b4"]
Sep 09 12:18:11.721808 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:18:11.721776    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf25063_9bb0_4520_a435_3519468d73a9.slice/crio-ed6b5c012b8ab760124eff494979707219284e52f0781b39912c7dcb16669553 WatchSource:0}: Error finding container ed6b5c012b8ab760124eff494979707219284e52f0781b39912c7dcb16669553: Status 404 returned error can't find the container with id ed6b5c012b8ab760124eff494979707219284e52f0781b39912c7dcb16669553
Sep 09 12:18:11.737608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:11.737575    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pq4zx"]
Sep 09 12:18:11.740001 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:18:11.739974    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ceb3c3e_f9cd_4c94_af97_d4126d0fac34.slice/crio-1c3f3651558950d5a8a3a18aa4972230df36cd9077dbf8be913ffa7e95899ce1 WatchSource:0}: Error finding container 1c3f3651558950d5a8a3a18aa4972230df36cd9077dbf8be913ffa7e95899ce1: Status 404 returned error can't find the container with id 1c3f3651558950d5a8a3a18aa4972230df36cd9077dbf8be913ffa7e95899ce1
Sep 09 12:18:12.120761 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:12.120725    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:12.188486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:12.188451    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:12.198620 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:12.198587    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx" event={"ID":"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34","Type":"ContainerStarted","Data":"1c3f3651558950d5a8a3a18aa4972230df36cd9077dbf8be913ffa7e95899ce1"}
Sep 09 12:18:12.199868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:12.199836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4" event={"ID":"adf25063-9bb0-4520-a435-3519468d73a9","Type":"ContainerStarted","Data":"ed6b5c012b8ab760124eff494979707219284e52f0781b39912c7dcb16669553"}
Sep 09 12:18:12.359255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:12.359220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:12.720984 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:12.720952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:12.891811 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:12.891776    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:14.541556 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:14.541509    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f65d7cd4c-tktjq" podUID="cf2e4e41-a979-4cf2-8399-dbd395b83642" containerName="console" containerID="cri-o://b6b0235281595d02f3b36030c437803b849e232d869423506a5b84635dff7c08" gracePeriod=15
Sep 09 12:18:14.712057 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:14.712007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:14.813559 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:14.813524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:15.216261 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.216191    2560 generic.go:356] "Generic (PLEG): container finished" podID="cf2e4e41-a979-4cf2-8399-dbd395b83642" containerID="b6b0235281595d02f3b36030c437803b849e232d869423506a5b84635dff7c08" exitCode=0
Sep 09 12:18:15.216261 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.216248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f65d7cd4c-tktjq" event={"ID":"cf2e4e41-a979-4cf2-8399-dbd395b83642","Type":"ContainerDied","Data":"b6b0235281595d02f3b36030c437803b849e232d869423506a5b84635dff7c08"}
Sep 09 12:18:15.628267 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.628242    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:18:15.684473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.684447    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-config\") pod \"cf2e4e41-a979-4cf2-8399-dbd395b83642\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") "
Sep 09 12:18:15.684580 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.684500    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-service-ca\") pod \"cf2e4e41-a979-4cf2-8399-dbd395b83642\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") "
Sep 09 12:18:15.684580 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.684527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-oauth-serving-cert\") pod \"cf2e4e41-a979-4cf2-8399-dbd395b83642\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") "
Sep 09 12:18:15.684797 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.684773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-trusted-ca-bundle\") pod \"cf2e4e41-a979-4cf2-8399-dbd395b83642\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") "
Sep 09 12:18:15.684882 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.684832    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-oauth-config\") pod \"cf2e4e41-a979-4cf2-8399-dbd395b83642\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") "
Sep 09 12:18:15.684939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.684869    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-config" (OuterVolumeSpecName: "console-config") pod "cf2e4e41-a979-4cf2-8399-dbd395b83642" (UID: "cf2e4e41-a979-4cf2-8399-dbd395b83642"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:18:15.685039 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.684931    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fszlw\" (UniqueName: \"kubernetes.io/projected/cf2e4e41-a979-4cf2-8399-dbd395b83642-kube-api-access-fszlw\") pod \"cf2e4e41-a979-4cf2-8399-dbd395b83642\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") "
Sep 09 12:18:15.685135 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.685115    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-serving-cert\") pod \"cf2e4e41-a979-4cf2-8399-dbd395b83642\" (UID: \"cf2e4e41-a979-4cf2-8399-dbd395b83642\") "
Sep 09 12:18:15.685325 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.685018    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf2e4e41-a979-4cf2-8399-dbd395b83642" (UID: "cf2e4e41-a979-4cf2-8399-dbd395b83642"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:18:15.685404 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.685384    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-config\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:18:15.685467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.685405    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-oauth-serving-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:18:15.685467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.685400    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf2e4e41-a979-4cf2-8399-dbd395b83642" (UID: "cf2e4e41-a979-4cf2-8399-dbd395b83642"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:18:15.685578 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.685542    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf2e4e41-a979-4cf2-8399-dbd395b83642" (UID: "cf2e4e41-a979-4cf2-8399-dbd395b83642"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:18:15.687265 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.687243    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf2e4e41-a979-4cf2-8399-dbd395b83642" (UID: "cf2e4e41-a979-4cf2-8399-dbd395b83642"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:18:15.687391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.687367    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf2e4e41-a979-4cf2-8399-dbd395b83642-kube-api-access-fszlw" (OuterVolumeSpecName: "kube-api-access-fszlw") pod "cf2e4e41-a979-4cf2-8399-dbd395b83642" (UID: "cf2e4e41-a979-4cf2-8399-dbd395b83642"). InnerVolumeSpecName "kube-api-access-fszlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:18:15.687884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.687862    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf2e4e41-a979-4cf2-8399-dbd395b83642" (UID: "cf2e4e41-a979-4cf2-8399-dbd395b83642"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:18:15.786433 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.786405    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:18:15.786433 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.786432    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2e4e41-a979-4cf2-8399-dbd395b83642-trusted-ca-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:18:15.786614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.786444    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-oauth-config\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:18:15.786614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.786458    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fszlw\" (UniqueName: \"kubernetes.io/projected/cf2e4e41-a979-4cf2-8399-dbd395b83642-kube-api-access-fszlw\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:18:15.786614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:15.786470    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf2e4e41-a979-4cf2-8399-dbd395b83642-console-serving-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:18:16.222919 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.222867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx" event={"ID":"8ceb3c3e-f9cd-4c94-af97-d4126d0fac34","Type":"ContainerStarted","Data":"f4721dd714d7591451794a607ff947688636d43dbb96ef7c332b9211e8f18560"}
Sep 09 12:18:16.223088 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.223041    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:16.224459 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.224433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4" event={"ID":"adf25063-9bb0-4520-a435-3519468d73a9","Type":"ContainerStarted","Data":"3c429774aa952d8a2122bb0ab9cb435f8e7a5743ad7ea7da930e111dc1b34a5d"}
Sep 09 12:18:16.224581 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.224485    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:16.225785 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.225764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f65d7cd4c-tktjq" event={"ID":"cf2e4e41-a979-4cf2-8399-dbd395b83642","Type":"ContainerDied","Data":"5d4c5300e9c8905e7a256b5a4bd34000f12b3c09d71098b8905bc1cb17b4ce68"}
Sep 09 12:18:16.225785 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.225783    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f65d7cd4c-tktjq"
Sep 09 12:18:16.225903 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.225811    2560 scope.go:117] "RemoveContainer" containerID="b6b0235281595d02f3b36030c437803b849e232d869423506a5b84635dff7c08"
Sep 09 12:18:16.242588 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.242542    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx" podStartSLOduration=2.3314654839999998 podStartE2EDuration="6.242522538s" totalImagesPullingTime="3.911057054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:18:16.240046264 +0000 UTC m=+412.286171443" watchObservedRunningTime="2026-09-09 12:18:16.242522538 +0000 UTC m=+412.288647713"
Sep 09 12:18:16.256088 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.256059    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f65d7cd4c-tktjq"]
Sep 09 12:18:16.257746 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.257721    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f65d7cd4c-tktjq"]
Sep 09 12:18:16.274178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.274129    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4" podStartSLOduration=1.358057524 podStartE2EDuration="5.274118059s" totalImagesPullingTime="3.916060535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:18:16.272652092 +0000 UTC m=+412.318777272" watchObservedRunningTime="2026-09-09 12:18:16.274118059 +0000 UTC m=+412.320243230"
Sep 09 12:18:16.399426 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:16.399397    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf2e4e41-a979-4cf2-8399-dbd395b83642" path="/var/lib/kubelet/pods/cf2e4e41-a979-4cf2-8399-dbd395b83642/volumes"
Sep 09 12:18:18.268449 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.268418    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"]
Sep 09 12:18:18.268840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.268732    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf2e4e41-a979-4cf2-8399-dbd395b83642" containerName="console"
Sep 09 12:18:18.268840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.268743    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf2e4e41-a979-4cf2-8399-dbd395b83642" containerName="console"
Sep 09 12:18:18.268840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.268804    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf2e4e41-a979-4cf2-8399-dbd395b83642" containerName="console"
Sep 09 12:18:18.271101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.271085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.274934 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.274911    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 12:18:18.275137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.275119    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 12:18:18.275219 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.275168    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 12:18:18.275275 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.275253    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lfhgf\""
Sep 09 12:18:18.275359 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.275316    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 12:18:18.298871 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.298842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"]
Sep 09 12:18:18.307212 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.307187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.307341 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.307234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.307341 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.307273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.307428 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.307367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.307428 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.307417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.307513 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.307445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.307567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.307532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2qch\" (UniqueName: \"kubernetes.io/projected/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-kube-api-access-b2qch\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.408203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.408170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.408203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.408209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.408486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.408226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.408486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.408250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2qch\" (UniqueName: \"kubernetes.io/projected/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-kube-api-access-b2qch\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.408486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.408267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.408486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.408333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.408486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.408376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.409069 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.409039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.410660 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.410633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.410750 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.410673    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.410805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.410749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.410805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.410766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.419104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.419083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.419388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.419370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2qch\" (UniqueName: \"kubernetes.io/projected/6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa-kube-api-access-b2qch\") pod \"istiod-openshift-gateway-5677ccb49b-m8t9v\" (UID: \"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.582357 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.582315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:18.865675 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:18.865645    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"]
Sep 09 12:18:18.867521 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:18:18.867494    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9965f4_ff12_4c24_bfde_a1b02ae4f3fa.slice/crio-933f05b4a74573f87c6b1a36384610596bce1c4b67b2c928b81ad7470508f91c WatchSource:0}: Error finding container 933f05b4a74573f87c6b1a36384610596bce1c4b67b2c928b81ad7470508f91c: Status 404 returned error can't find the container with id 933f05b4a74573f87c6b1a36384610596bce1c4b67b2c928b81ad7470508f91c
Sep 09 12:18:19.241830 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:19.241748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v" event={"ID":"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa","Type":"ContainerStarted","Data":"933f05b4a74573f87c6b1a36384610596bce1c4b67b2c928b81ad7470508f91c"}
Sep 09 12:18:21.047664 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:21.047612    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:18:21.047929 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:21.047698    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:18:21.257720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:21.257681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v" event={"ID":"6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa","Type":"ContainerStarted","Data":"679e68fccdbd1bd922f4a294f5ad7313efdf1e239c254b0f715ce1b954463b1b"}
Sep 09 12:18:21.257888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:21.257842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:21.296042 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:21.295938    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v" podStartSLOduration=1.118799277 podStartE2EDuration="3.29591899s" totalImagesPullingTime="2.177119713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:18:21.294922457 +0000 UTC m=+417.341047634" watchObservedRunningTime="2026-09-09 12:18:21.29591899 +0000 UTC m=+417.342044169"
Sep 09 12:18:21.860624 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:21.860563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:22.065098 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.065060    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"]
Sep 09 12:18:22.069136 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.069110    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:22.083237 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.083216    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 12:18:22.083723 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.083706    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dkktv\""
Sep 09 12:18:22.085182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.085158    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:22.101924 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.101888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"]
Sep 09 12:18:22.141178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.141094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b37783f0-2da6-4a95-9c62-fd79b1019313-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vbn7s\" (UID: \"b37783f0-2da6-4a95-9c62-fd79b1019313\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:22.141178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.141143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj9pl\" (UniqueName: \"kubernetes.io/projected/b37783f0-2da6-4a95-9c62-fd79b1019313-kube-api-access-tj9pl\") pod \"llmisvc-controller-manager-777c6bd7d5-vbn7s\" (UID: \"b37783f0-2da6-4a95-9c62-fd79b1019313\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:22.242062 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.242027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b37783f0-2da6-4a95-9c62-fd79b1019313-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vbn7s\" (UID: \"b37783f0-2da6-4a95-9c62-fd79b1019313\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:22.242233 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.242076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj9pl\" (UniqueName: \"kubernetes.io/projected/b37783f0-2da6-4a95-9c62-fd79b1019313-kube-api-access-tj9pl\") pod \"llmisvc-controller-manager-777c6bd7d5-vbn7s\" (UID: \"b37783f0-2da6-4a95-9c62-fd79b1019313\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:22.244481 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.244450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b37783f0-2da6-4a95-9c62-fd79b1019313-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vbn7s\" (UID: \"b37783f0-2da6-4a95-9c62-fd79b1019313\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:22.264616 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.264590    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-m8t9v container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 12:18:22.264741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.264634    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v" podUID="6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 12:18:22.277844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.277823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj9pl\" (UniqueName: \"kubernetes.io/projected/b37783f0-2da6-4a95-9c62-fd79b1019313-kube-api-access-tj9pl\") pod \"llmisvc-controller-manager-777c6bd7d5-vbn7s\" (UID: \"b37783f0-2da6-4a95-9c62-fd79b1019313\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:22.324631 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.324602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:22.382629 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.382593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:22.461189 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.461160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:22.672583 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:22.672549    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"]
Sep 09 12:18:22.672754 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:18:22.672727    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb37783f0_2da6_4a95_9c62_fd79b1019313.slice/crio-13c6f329c63036bb5a8ac5ccf61b1757557cbcd18ad0689739b98e6a0402f97b WatchSource:0}: Error finding container 13c6f329c63036bb5a8ac5ccf61b1757557cbcd18ad0689739b98e6a0402f97b: Status 404 returned error can't find the container with id 13c6f329c63036bb5a8ac5ccf61b1757557cbcd18ad0689739b98e6a0402f97b
Sep 09 12:18:23.268285 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:23.268243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s" event={"ID":"b37783f0-2da6-4a95-9c62-fd79b1019313","Type":"ContainerStarted","Data":"13c6f329c63036bb5a8ac5ccf61b1757557cbcd18ad0689739b98e6a0402f97b"}
Sep 09 12:18:23.388130 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:23.388093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:24.037475 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:24.037377    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:24.180666 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:24.180635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:18:25.264442 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:25.264413    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-m8t9v"
Sep 09 12:18:27.233618 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:27.233592    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pq4zx"
Sep 09 12:18:27.235781 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:27.235765    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cs2b4"
Sep 09 12:18:27.292263 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:27.292228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s" event={"ID":"b37783f0-2da6-4a95-9c62-fd79b1019313","Type":"ContainerStarted","Data":"5b9a47a5b687321de7308f2f5ce74be94257c9cc12bede3d048b37ad1f1acde7"}
Sep 09 12:18:27.292420 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:27.292326    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:18:27.370970 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:27.370908    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s" podStartSLOduration=2.830862426 podStartE2EDuration="6.37088476s" totalImagesPullingTime="3.540022334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:18:27.366756571 +0000 UTC m=+423.412881750" watchObservedRunningTime="2026-09-09 12:18:27.37088476 +0000 UTC m=+423.417009940"
Sep 09 12:18:58.299322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:18:58.299224    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vbn7s"
Sep 09 12:19:12.504146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:12.504103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:12.574168 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:12.574138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:15.564494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.564458    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"]
Sep 09 12:19:15.573215 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.573192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.576456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.576423    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 12:19:15.576819 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.576799    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v5gb7\""
Sep 09 12:19:15.577234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.577212    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 12:19:15.579328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.579286    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"]
Sep 09 12:19:15.597645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.597618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.597743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.597652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.597743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.597679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4vtn\" (UniqueName: \"kubernetes.io/projected/2d62a3ce-a037-4670-b2e4-84fc6001d35a-kube-api-access-c4vtn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.667032 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.666999    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"]
Sep 09 12:19:15.669663 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.669637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.679192 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.679168    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"]
Sep 09 12:19:15.698956 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.698930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.699070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.698963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.699070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.698982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.699070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.699005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.699070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.699033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4vtn\" (UniqueName: \"kubernetes.io/projected/2d62a3ce-a037-4670-b2e4-84fc6001d35a-kube-api-access-c4vtn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.699070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.699066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hg49\" (UniqueName: \"kubernetes.io/projected/2f993140-0c2e-479b-90a4-3ed19e499c7f-kube-api-access-9hg49\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.699413 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.699391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.699470 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.699396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.708690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.708660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4vtn\" (UniqueName: \"kubernetes.io/projected/2d62a3ce-a037-4670-b2e4-84fc6001d35a-kube-api-access-c4vtn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.764461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.764430    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"]
Sep 09 12:19:15.767022 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.767008    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.776558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.776536    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"]
Sep 09 12:19:15.800270 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.800239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.800404 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.800285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.800404 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.800345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hg49\" (UniqueName: \"kubernetes.io/projected/2f993140-0c2e-479b-90a4-3ed19e499c7f-kube-api-access-9hg49\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.800404 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.800380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2wg9\" (UniqueName: \"kubernetes.io/projected/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-kube-api-access-d2wg9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.800532 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.800410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.800532 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.800491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.800661 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.800640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.800661 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.800655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.809526 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.809501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hg49\" (UniqueName: \"kubernetes.io/projected/2f993140-0c2e-479b-90a4-3ed19e499c7f-kube-api-access-9hg49\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:15.865215 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.865153    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"]
Sep 09 12:19:15.868103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.868089    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:15.878898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.878875    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"]
Sep 09 12:19:15.885916 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.885897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:15.901170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.901142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:15.901261 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.901212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2wg9\" (UniqueName: \"kubernetes.io/projected/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-kube-api-access-d2wg9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.901261 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.901244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.901385 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.901312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.901385 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.901360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:15.901516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.901390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgglb\" (UniqueName: \"kubernetes.io/projected/d6627c13-7cb9-41d6-9a34-8acf432ab733-kube-api-access-vgglb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:15.901640 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.901619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.901696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.901662    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.910838 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.910810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2wg9\" (UniqueName: \"kubernetes.io/projected/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-kube-api-access-d2wg9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:15.979095 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:15.979067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:16.001863 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.001829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:16.002032 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.001867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgglb\" (UniqueName: \"kubernetes.io/projected/d6627c13-7cb9-41d6-9a34-8acf432ab733-kube-api-access-vgglb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:16.002032 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.001946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:16.002276 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.002250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:16.002361 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.002347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:16.011733 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.011700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgglb\" (UniqueName: \"kubernetes.io/projected/d6627c13-7cb9-41d6-9a34-8acf432ab733-kube-api-access-vgglb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:16.076643 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.076609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:16.161211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.161183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"]
Sep 09 12:19:16.163202 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:19:16.163178    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d62a3ce_a037_4670_b2e4_84fc6001d35a.slice/crio-c432836eeb53609ddf33e54094fffbe9ea04f652eb4197b8b0475440af2c7dad WatchSource:0}: Error finding container c432836eeb53609ddf33e54094fffbe9ea04f652eb4197b8b0475440af2c7dad: Status 404 returned error can't find the container with id c432836eeb53609ddf33e54094fffbe9ea04f652eb4197b8b0475440af2c7dad
Sep 09 12:19:16.177924 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.177880    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:16.257038 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.257011    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"]
Sep 09 12:19:16.258879 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:19:16.258853    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f993140_0c2e_479b_90a4_3ed19e499c7f.slice/crio-8c288f86bf68b4678701c93425727005a7d7656228d5dab36be67a6b79851a7e WatchSource:0}: Error finding container 8c288f86bf68b4678701c93425727005a7d7656228d5dab36be67a6b79851a7e: Status 404 returned error can't find the container with id 8c288f86bf68b4678701c93425727005a7d7656228d5dab36be67a6b79851a7e
Sep 09 12:19:16.351023 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.351000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"]
Sep 09 12:19:16.352731 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:19:16.352699    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6b356a_91ab_4bef_bf5a_2d83469dd23b.slice/crio-9957a80c6de545917931752dff0589625075c6cf18ce1a9c60f5111e645afbca WatchSource:0}: Error finding container 9957a80c6de545917931752dff0589625075c6cf18ce1a9c60f5111e645afbca: Status 404 returned error can't find the container with id 9957a80c6de545917931752dff0589625075c6cf18ce1a9c60f5111e645afbca
Sep 09 12:19:16.448413 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.448389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"]
Sep 09 12:19:16.464610 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:19:16.464582    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6627c13_7cb9_41d6_9a34_8acf432ab733.slice/crio-43f803449e4ff5551f960b1196cd3e7fe9594be265d2306b9b619d2e6e51cad3 WatchSource:0}: Error finding container 43f803449e4ff5551f960b1196cd3e7fe9594be265d2306b9b619d2e6e51cad3: Status 404 returned error can't find the container with id 43f803449e4ff5551f960b1196cd3e7fe9594be265d2306b9b619d2e6e51cad3
Sep 09 12:19:16.519958 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.519925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff" event={"ID":"d6627c13-7cb9-41d6-9a34-8acf432ab733","Type":"ContainerStarted","Data":"43f803449e4ff5551f960b1196cd3e7fe9594be265d2306b9b619d2e6e51cad3"}
Sep 09 12:19:16.521555 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.521521    2560 generic.go:356] "Generic (PLEG): container finished" podID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerID="f39dfed2e3c9d335775aa553e0e9fb7740935772cb7efe68e862260b95e7c99f" exitCode=0
Sep 09 12:19:16.521645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.521597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9" event={"ID":"2d62a3ce-a037-4670-b2e4-84fc6001d35a","Type":"ContainerDied","Data":"f39dfed2e3c9d335775aa553e0e9fb7740935772cb7efe68e862260b95e7c99f"}
Sep 09 12:19:16.521704 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.521644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9" event={"ID":"2d62a3ce-a037-4670-b2e4-84fc6001d35a","Type":"ContainerStarted","Data":"c432836eeb53609ddf33e54094fffbe9ea04f652eb4197b8b0475440af2c7dad"}
Sep 09 12:19:16.523399 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.523377    2560 generic.go:356] "Generic (PLEG): container finished" podID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerID="2a4ae29a77fb8646b24a0b110b5d5e72dc6b1bc501c1c2f33a60058a64899a98" exitCode=0
Sep 09 12:19:16.523492 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.523458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt" event={"ID":"2f993140-0c2e-479b-90a4-3ed19e499c7f","Type":"ContainerDied","Data":"2a4ae29a77fb8646b24a0b110b5d5e72dc6b1bc501c1c2f33a60058a64899a98"}
Sep 09 12:19:16.523549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.523521    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt" event={"ID":"2f993140-0c2e-479b-90a4-3ed19e499c7f","Type":"ContainerStarted","Data":"8c288f86bf68b4678701c93425727005a7d7656228d5dab36be67a6b79851a7e"}
Sep 09 12:19:16.525247 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.525174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz" event={"ID":"1e6b356a-91ab-4bef-bf5a-2d83469dd23b","Type":"ContainerStarted","Data":"02afbd664b8a344492c1b57d8c3ebed66130eccaffb1212eec1d3e6145f708bb"}
Sep 09 12:19:16.525247 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:16.525218    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz" event={"ID":"1e6b356a-91ab-4bef-bf5a-2d83469dd23b","Type":"ContainerStarted","Data":"9957a80c6de545917931752dff0589625075c6cf18ce1a9c60f5111e645afbca"}
Sep 09 12:19:17.535702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:17.535244    2560 generic.go:356] "Generic (PLEG): container finished" podID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerID="c8d86ce19cb93a79526fa393a44a33dc136de8650158689a75890826c5e8e8e0" exitCode=0
Sep 09 12:19:17.535702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:17.535325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9" event={"ID":"2d62a3ce-a037-4670-b2e4-84fc6001d35a","Type":"ContainerDied","Data":"c8d86ce19cb93a79526fa393a44a33dc136de8650158689a75890826c5e8e8e0"}
Sep 09 12:19:17.543532 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:17.543505    2560 generic.go:356] "Generic (PLEG): container finished" podID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerID="02afbd664b8a344492c1b57d8c3ebed66130eccaffb1212eec1d3e6145f708bb" exitCode=0
Sep 09 12:19:17.543663 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:17.543575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz" event={"ID":"1e6b356a-91ab-4bef-bf5a-2d83469dd23b","Type":"ContainerDied","Data":"02afbd664b8a344492c1b57d8c3ebed66130eccaffb1212eec1d3e6145f708bb"}
Sep 09 12:19:17.545529 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:17.545507    2560 generic.go:356] "Generic (PLEG): container finished" podID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerID="e7e99ab2335bf4d1500d48a6782564f7b8a21d40588d2722ec6e22f92f705fdd" exitCode=0
Sep 09 12:19:17.545641 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:17.545536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff" event={"ID":"d6627c13-7cb9-41d6-9a34-8acf432ab733","Type":"ContainerDied","Data":"e7e99ab2335bf4d1500d48a6782564f7b8a21d40588d2722ec6e22f92f705fdd"}
Sep 09 12:19:18.552488 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:18.552456    2560 generic.go:356] "Generic (PLEG): container finished" podID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerID="2ce32e930e262c88e9f0a56be2016299a626052c0a788d3ab2ba872e5998d797" exitCode=0
Sep 09 12:19:18.552844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:18.552549    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff" event={"ID":"d6627c13-7cb9-41d6-9a34-8acf432ab733","Type":"ContainerDied","Data":"2ce32e930e262c88e9f0a56be2016299a626052c0a788d3ab2ba872e5998d797"}
Sep 09 12:19:18.557613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:18.555961    2560 generic.go:356] "Generic (PLEG): container finished" podID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerID="1c6fd2571d8c6ce937699f50b51851bbf65189302ee7964ca914aee78af4d4b0" exitCode=0
Sep 09 12:19:18.557613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:18.556069    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9" event={"ID":"2d62a3ce-a037-4670-b2e4-84fc6001d35a","Type":"ContainerDied","Data":"1c6fd2571d8c6ce937699f50b51851bbf65189302ee7964ca914aee78af4d4b0"}
Sep 09 12:19:18.559189 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:18.559168    2560 generic.go:356] "Generic (PLEG): container finished" podID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerID="2c927fea6879f581525c9c068ec536bbcb0783c1bef09085d15f0c0071927611" exitCode=0
Sep 09 12:19:18.559269 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:18.559247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt" event={"ID":"2f993140-0c2e-479b-90a4-3ed19e499c7f","Type":"ContainerDied","Data":"2c927fea6879f581525c9c068ec536bbcb0783c1bef09085d15f0c0071927611"}
Sep 09 12:19:18.561219 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:18.561170    2560 generic.go:356] "Generic (PLEG): container finished" podID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerID="8f3b49126f7b05c8e5d3b46e0755e64376799de77b1c9012310573bfe65cf204" exitCode=0
Sep 09 12:19:18.561326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:18.561243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz" event={"ID":"1e6b356a-91ab-4bef-bf5a-2d83469dd23b","Type":"ContainerDied","Data":"8f3b49126f7b05c8e5d3b46e0755e64376799de77b1c9012310573bfe65cf204"}
Sep 09 12:19:19.568265 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.568228    2560 generic.go:356] "Generic (PLEG): container finished" podID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerID="1f1ab873baeacccb3fbea44cdd436f9e4d476be85171086631b9f01aee673920" exitCode=0
Sep 09 12:19:19.568702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.568326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff" event={"ID":"d6627c13-7cb9-41d6-9a34-8acf432ab733","Type":"ContainerDied","Data":"1f1ab873baeacccb3fbea44cdd436f9e4d476be85171086631b9f01aee673920"}
Sep 09 12:19:19.570345 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.570322    2560 generic.go:356] "Generic (PLEG): container finished" podID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerID="e53caebf615c45e8a82156e195834fcf27756f74d62f10fd17e2c960d6cb7325" exitCode=0
Sep 09 12:19:19.570435 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.570350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt" event={"ID":"2f993140-0c2e-479b-90a4-3ed19e499c7f","Type":"ContainerDied","Data":"e53caebf615c45e8a82156e195834fcf27756f74d62f10fd17e2c960d6cb7325"}
Sep 09 12:19:19.572393 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.572373    2560 generic.go:356] "Generic (PLEG): container finished" podID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerID="998b727658f1d3c838e30ff49925e7a4ef4c213381b7102636302903064abee0" exitCode=0
Sep 09 12:19:19.572498 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.572442    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz" event={"ID":"1e6b356a-91ab-4bef-bf5a-2d83469dd23b","Type":"ContainerDied","Data":"998b727658f1d3c838e30ff49925e7a4ef4c213381b7102636302903064abee0"}
Sep 09 12:19:19.695652 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.695628    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:19.736641 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.736613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-util\") pod \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") "
Sep 09 12:19:19.736641 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.736645    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4vtn\" (UniqueName: \"kubernetes.io/projected/2d62a3ce-a037-4670-b2e4-84fc6001d35a-kube-api-access-c4vtn\") pod \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") "
Sep 09 12:19:19.736865 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.736681    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-bundle\") pod \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\" (UID: \"2d62a3ce-a037-4670-b2e4-84fc6001d35a\") "
Sep 09 12:19:19.737282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.737251    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-bundle" (OuterVolumeSpecName: "bundle") pod "2d62a3ce-a037-4670-b2e4-84fc6001d35a" (UID: "2d62a3ce-a037-4670-b2e4-84fc6001d35a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:19.738924 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.738892    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d62a3ce-a037-4670-b2e4-84fc6001d35a-kube-api-access-c4vtn" (OuterVolumeSpecName: "kube-api-access-c4vtn") pod "2d62a3ce-a037-4670-b2e4-84fc6001d35a" (UID: "2d62a3ce-a037-4670-b2e4-84fc6001d35a"). InnerVolumeSpecName "kube-api-access-c4vtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:19:19.741901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.741876    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-util" (OuterVolumeSpecName: "util") pod "2d62a3ce-a037-4670-b2e4-84fc6001d35a" (UID: "2d62a3ce-a037-4670-b2e4-84fc6001d35a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:19.838151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.838076    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-util\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:19.838151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.838104    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4vtn\" (UniqueName: \"kubernetes.io/projected/2d62a3ce-a037-4670-b2e4-84fc6001d35a-kube-api-access-c4vtn\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:19.838151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:19.838114    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d62a3ce-a037-4670-b2e4-84fc6001d35a-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.579216 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.579186    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9"
Sep 09 12:19:20.579608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.579216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7x85p9" event={"ID":"2d62a3ce-a037-4670-b2e4-84fc6001d35a","Type":"ContainerDied","Data":"c432836eeb53609ddf33e54094fffbe9ea04f652eb4197b8b0475440af2c7dad"}
Sep 09 12:19:20.579608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.579266    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c432836eeb53609ddf33e54094fffbe9ea04f652eb4197b8b0475440af2c7dad"
Sep 09 12:19:20.726205 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.726178    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:20.761308 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.761269    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:20.764767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.764747    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:20.846741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.846711    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-bundle\") pod \"2f993140-0c2e-479b-90a4-3ed19e499c7f\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") "
Sep 09 12:19:20.846891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.846749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-util\") pod \"2f993140-0c2e-479b-90a4-3ed19e499c7f\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") "
Sep 09 12:19:20.846891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.846774    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hg49\" (UniqueName: \"kubernetes.io/projected/2f993140-0c2e-479b-90a4-3ed19e499c7f-kube-api-access-9hg49\") pod \"2f993140-0c2e-479b-90a4-3ed19e499c7f\" (UID: \"2f993140-0c2e-479b-90a4-3ed19e499c7f\") "
Sep 09 12:19:20.846891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.846806    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-util\") pod \"d6627c13-7cb9-41d6-9a34-8acf432ab733\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") "
Sep 09 12:19:20.846891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.846850    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-bundle\") pod \"d6627c13-7cb9-41d6-9a34-8acf432ab733\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") "
Sep 09 12:19:20.846891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.846883    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgglb\" (UniqueName: \"kubernetes.io/projected/d6627c13-7cb9-41d6-9a34-8acf432ab733-kube-api-access-vgglb\") pod \"d6627c13-7cb9-41d6-9a34-8acf432ab733\" (UID: \"d6627c13-7cb9-41d6-9a34-8acf432ab733\") "
Sep 09 12:19:20.847155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.846915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2wg9\" (UniqueName: \"kubernetes.io/projected/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-kube-api-access-d2wg9\") pod \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") "
Sep 09 12:19:20.847155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.846969    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-bundle\") pod \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") "
Sep 09 12:19:20.847918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.847446    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-util\") pod \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\" (UID: \"1e6b356a-91ab-4bef-bf5a-2d83469dd23b\") "
Sep 09 12:19:20.847918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.847574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-bundle" (OuterVolumeSpecName: "bundle") pod "1e6b356a-91ab-4bef-bf5a-2d83469dd23b" (UID: "1e6b356a-91ab-4bef-bf5a-2d83469dd23b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:20.847918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.847708    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-bundle" (OuterVolumeSpecName: "bundle") pod "2f993140-0c2e-479b-90a4-3ed19e499c7f" (UID: "2f993140-0c2e-479b-90a4-3ed19e499c7f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:20.848140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.847915    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-bundle" (OuterVolumeSpecName: "bundle") pod "d6627c13-7cb9-41d6-9a34-8acf432ab733" (UID: "d6627c13-7cb9-41d6-9a34-8acf432ab733"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:20.848140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.848007    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.848140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.848024    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.849561 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.849527    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f993140-0c2e-479b-90a4-3ed19e499c7f-kube-api-access-9hg49" (OuterVolumeSpecName: "kube-api-access-9hg49") pod "2f993140-0c2e-479b-90a4-3ed19e499c7f" (UID: "2f993140-0c2e-479b-90a4-3ed19e499c7f"). InnerVolumeSpecName "kube-api-access-9hg49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:19:20.849669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.849568    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6627c13-7cb9-41d6-9a34-8acf432ab733-kube-api-access-vgglb" (OuterVolumeSpecName: "kube-api-access-vgglb") pod "d6627c13-7cb9-41d6-9a34-8acf432ab733" (UID: "d6627c13-7cb9-41d6-9a34-8acf432ab733"). InnerVolumeSpecName "kube-api-access-vgglb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:19:20.849736 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.849679    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-kube-api-access-d2wg9" (OuterVolumeSpecName: "kube-api-access-d2wg9") pod "1e6b356a-91ab-4bef-bf5a-2d83469dd23b" (UID: "1e6b356a-91ab-4bef-bf5a-2d83469dd23b"). InnerVolumeSpecName "kube-api-access-d2wg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:19:20.853665 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.853639    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-util" (OuterVolumeSpecName: "util") pod "d6627c13-7cb9-41d6-9a34-8acf432ab733" (UID: "d6627c13-7cb9-41d6-9a34-8acf432ab733"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:20.856985 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.856947    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-util" (OuterVolumeSpecName: "util") pod "1e6b356a-91ab-4bef-bf5a-2d83469dd23b" (UID: "1e6b356a-91ab-4bef-bf5a-2d83469dd23b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:20.857098 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.857084    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-util" (OuterVolumeSpecName: "util") pod "2f993140-0c2e-479b-90a4-3ed19e499c7f" (UID: "2f993140-0c2e-479b-90a4-3ed19e499c7f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:20.948725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.948652    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f993140-0c2e-479b-90a4-3ed19e499c7f-util\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.948725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.948687    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hg49\" (UniqueName: \"kubernetes.io/projected/2f993140-0c2e-479b-90a4-3ed19e499c7f-kube-api-access-9hg49\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.948725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.948699    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-util\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.948725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.948707    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6627c13-7cb9-41d6-9a34-8acf432ab733-bundle\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.948725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.948716    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgglb\" (UniqueName: \"kubernetes.io/projected/d6627c13-7cb9-41d6-9a34-8acf432ab733-kube-api-access-vgglb\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.948725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.948725    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2wg9\" (UniqueName: \"kubernetes.io/projected/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-kube-api-access-d2wg9\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:20.948725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:20.948734    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e6b356a-91ab-4bef-bf5a-2d83469dd23b-util\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:21.586848 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.586820    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz"
Sep 09 12:19:21.587278 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.586855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjjjqz" event={"ID":"1e6b356a-91ab-4bef-bf5a-2d83469dd23b","Type":"ContainerDied","Data":"9957a80c6de545917931752dff0589625075c6cf18ce1a9c60f5111e645afbca"}
Sep 09 12:19:21.587278 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.586902    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9957a80c6de545917931752dff0589625075c6cf18ce1a9c60f5111e645afbca"
Sep 09 12:19:21.588775 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.588748    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff"
Sep 09 12:19:21.588775 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.588765    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahccff" event={"ID":"d6627c13-7cb9-41d6-9a34-8acf432ab733","Type":"ContainerDied","Data":"43f803449e4ff5551f960b1196cd3e7fe9594be265d2306b9b619d2e6e51cad3"}
Sep 09 12:19:21.588916 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.588797    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43f803449e4ff5551f960b1196cd3e7fe9594be265d2306b9b619d2e6e51cad3"
Sep 09 12:19:21.590589 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.590571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt" event={"ID":"2f993140-0c2e-479b-90a4-3ed19e499c7f","Type":"ContainerDied","Data":"8c288f86bf68b4678701c93425727005a7d7656228d5dab36be67a6b79851a7e"}
Sep 09 12:19:21.590667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.590601    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c288f86bf68b4678701c93425727005a7d7656228d5dab36be67a6b79851a7e"
Sep 09 12:19:21.590667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:21.590613    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c697tkt"
Sep 09 12:19:23.839555 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:23.839522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:26.215645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:26.215611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:26.619691 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:26.619626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:27.661690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:27.661639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:29.053573 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:29.053536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:29.158399 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:29.158361    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:29.620610 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:29.620576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:30.019164 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:30.019077    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:30.516781 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:30.516744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:32.880892 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.880859    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"]
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881177    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerName="util"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881188    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerName="util"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881196    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerName="util"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881201    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerName="util"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881208    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerName="extract"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881214    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerName="extract"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881222    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerName="pull"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881227    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerName="pull"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881235    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerName="util"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881241    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerName="util"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881248    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerName="extract"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881253    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerName="extract"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881258    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerName="extract"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881263    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerName="extract"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881272    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerName="util"
Sep 09 12:19:32.881273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881277    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerName="util"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881285    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerName="pull"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881303    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerName="pull"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881309    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerName="pull"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881313    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerName="pull"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881320    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerName="extract"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881326    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerName="extract"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881333    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerName="pull"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881337    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerName="pull"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881388    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d62a3ce-a037-4670-b2e4-84fc6001d35a" containerName="extract"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881394    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f993140-0c2e-479b-90a4-3ed19e499c7f" containerName="extract"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881403    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e6b356a-91ab-4bef-bf5a-2d83469dd23b" containerName="extract"
Sep 09 12:19:32.881788 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.881408    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6627c13-7cb9-41d6-9a34-8acf432ab733" containerName="extract"
Sep 09 12:19:32.885527 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.885504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:32.888040 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.888013    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 12:19:32.888040 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.888014    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mc7gz\""
Sep 09 12:19:32.888208 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.888050    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 12:19:32.897129 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.897107    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"]
Sep 09 12:19:32.950637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.950606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxlgt\" (UID: \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:32.950795 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:32.950641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dkmk\" (UniqueName: \"kubernetes.io/projected/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-kube-api-access-5dkmk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxlgt\" (UID: \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:33.051520 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:33.051477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxlgt\" (UID: \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:33.051520 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:33.051523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dkmk\" (UniqueName: \"kubernetes.io/projected/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-kube-api-access-5dkmk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxlgt\" (UID: \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:33.051860 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:33.051843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxlgt\" (UID: \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:33.061468 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:33.061438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dkmk\" (UniqueName: \"kubernetes.io/projected/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-kube-api-access-5dkmk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-xxlgt\" (UID: \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:33.195764 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:33.195678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:33.420588 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:33.420554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:33.470398 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:33.470274    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"]
Sep 09 12:19:33.473094 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:19:33.473064    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79423f65_8d9c_4edc_89a0_8f1ae0d6b128.slice/crio-cdf327fc9f1da71dabceeea142345b3eec8fde6d817fa95dbfd17adab0e8601b WatchSource:0}: Error finding container cdf327fc9f1da71dabceeea142345b3eec8fde6d817fa95dbfd17adab0e8601b: Status 404 returned error can't find the container with id cdf327fc9f1da71dabceeea142345b3eec8fde6d817fa95dbfd17adab0e8601b
Sep 09 12:19:33.658104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:33.658070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt" event={"ID":"79423f65-8d9c-4edc-89a0-8f1ae0d6b128","Type":"ContainerStarted","Data":"cdf327fc9f1da71dabceeea142345b3eec8fde6d817fa95dbfd17adab0e8601b"}
Sep 09 12:19:34.106184 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:34.106140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:35.284636 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:35.284580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:36.559245 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:36.559205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:36.661254 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:36.661203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:38.692595 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:38.692554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt" event={"ID":"79423f65-8d9c-4edc-89a0-8f1ae0d6b128","Type":"ContainerStarted","Data":"7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316"}
Sep 09 12:19:38.693030 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:38.692624    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:38.714567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:38.714518    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt" podStartSLOduration=1.6898854559999998 podStartE2EDuration="6.714504625s" totalImagesPullingTime="5.024619169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:19:38.712350615 +0000 UTC m=+494.758475790" watchObservedRunningTime="2026-09-09 12:19:38.714504625 +0000 UTC m=+494.760629803"
Sep 09 12:19:41.072954 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:41.072904    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:41.189034 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:41.189003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:41.283247 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:41.283206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:41.378235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:41.378150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:41.870852 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:41.870816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:46.226070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:46.226020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:46.377890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:46.377847    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:46.441209 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:46.441176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:49.699305 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:49.699260    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:51.033221 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.033188    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"]
Sep 09 12:19:51.035766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.035744    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.049432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.049386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"]
Sep 09 12:19:51.150680 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.150649    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"]
Sep 09 12:19:51.150915 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:19:51.150897    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-c44dc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v" podUID="2f05f007-ef7b-4a67-a209-8aeb2e2a60b8"
Sep 09 12:19:51.201481 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.201428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c44dc\" (UniqueName: \"kubernetes.io/projected/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-kube-api-access-c44dc\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-v985v\" (UID: \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.201626 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.201496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-v985v\" (UID: \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.302718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.302632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c44dc\" (UniqueName: \"kubernetes.io/projected/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-kube-api-access-c44dc\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-v985v\" (UID: \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.302718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.302677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-v985v\" (UID: \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.303006 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.302992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-v985v\" (UID: \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.313929 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.313907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c44dc\" (UniqueName: \"kubernetes.io/projected/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-kube-api-access-c44dc\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-v985v\" (UID: \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.757805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.757773    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.764395 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.764373    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:51.907701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.907672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c44dc\" (UniqueName: \"kubernetes.io/projected/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-kube-api-access-c44dc\") pod \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\" (UID: \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\") "
Sep 09 12:19:51.907701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.907704    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-extensions-socket-volume\") pod \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\" (UID: \"2f05f007-ef7b-4a67-a209-8aeb2e2a60b8\") "
Sep 09 12:19:51.908006 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.907974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f05f007-ef7b-4a67-a209-8aeb2e2a60b8" (UID: "2f05f007-ef7b-4a67-a209-8aeb2e2a60b8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:51.909765 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:51.909740    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-kube-api-access-c44dc" (OuterVolumeSpecName: "kube-api-access-c44dc") pod "2f05f007-ef7b-4a67-a209-8aeb2e2a60b8" (UID: "2f05f007-ef7b-4a67-a209-8aeb2e2a60b8"). InnerVolumeSpecName "kube-api-access-c44dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:19:52.008605 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.008535    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-extensions-socket-volume\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:52.008605 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.008560    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c44dc\" (UniqueName: \"kubernetes.io/projected/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8-kube-api-access-c44dc\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:52.140101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.140061    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"]
Sep 09 12:19:52.142357 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.142333    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"]
Sep 09 12:19:52.144718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.144701    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:52.148179 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.148159    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"]
Sep 09 12:19:52.164711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.164685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"]
Sep 09 12:19:52.172390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.172366    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"]
Sep 09 12:19:52.172590 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.172567    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt" podUID="79423f65-8d9c-4edc-89a0-8f1ae0d6b128" containerName="manager" containerID="cri-o://7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316" gracePeriod=2
Sep 09 12:19:52.179738 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.179712    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"]
Sep 09 12:19:52.190238 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:19:52.190205    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xxlgt\" is forbidden: User \"system:node:ip-10-0-136-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-24.ec2.internal' and this object" podUID="79423f65-8d9c-4edc-89a0-8f1ae0d6b128" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:52.204265 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.204237    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"]
Sep 09 12:19:52.204745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.204727    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79423f65-8d9c-4edc-89a0-8f1ae0d6b128" containerName="manager"
Sep 09 12:19:52.204745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.204746    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="79423f65-8d9c-4edc-89a0-8f1ae0d6b128" containerName="manager"
Sep 09 12:19:52.204880 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.204813    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="79423f65-8d9c-4edc-89a0-8f1ae0d6b128" containerName="manager"
Sep 09 12:19:52.206760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.206743    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:52.209018 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:19:52.208988    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-xxlgt\" is forbidden: User \"system:node:ip-10-0-136-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-24.ec2.internal' and this object" podUID="79423f65-8d9c-4edc-89a0-8f1ae0d6b128" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:52.227444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.227419    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"]
Sep 09 12:19:52.311568 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.311535    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fztkx\" (UID: \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:52.311681 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.311583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04509b3e-3ed9-4240-b72a-2bc452f59dad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-j4hhz\" (UID: \"04509b3e-3ed9-4240-b72a-2bc452f59dad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:52.311717 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.311701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp8qn\" (UniqueName: \"kubernetes.io/projected/04509b3e-3ed9-4240-b72a-2bc452f59dad-kube-api-access-gp8qn\") pod \"kuadrant-operator-controller-manager-5f685c496f-j4hhz\" (UID: \"04509b3e-3ed9-4240-b72a-2bc452f59dad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:52.311760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.311735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj5gk\" (UniqueName: \"kubernetes.io/projected/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-kube-api-access-wj5gk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fztkx\" (UID: \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:52.400059 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.400023    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f05f007-ef7b-4a67-a209-8aeb2e2a60b8" path="/var/lib/kubelet/pods/2f05f007-ef7b-4a67-a209-8aeb2e2a60b8/volumes"
Sep 09 12:19:52.402214 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.402195    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:52.412823 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.412804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp8qn\" (UniqueName: \"kubernetes.io/projected/04509b3e-3ed9-4240-b72a-2bc452f59dad-kube-api-access-gp8qn\") pod \"kuadrant-operator-controller-manager-5f685c496f-j4hhz\" (UID: \"04509b3e-3ed9-4240-b72a-2bc452f59dad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:52.412924 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.412832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj5gk\" (UniqueName: \"kubernetes.io/projected/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-kube-api-access-wj5gk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fztkx\" (UID: \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:52.412924 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.412856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fztkx\" (UID: \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:52.413035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.412971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04509b3e-3ed9-4240-b72a-2bc452f59dad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-j4hhz\" (UID: \"04509b3e-3ed9-4240-b72a-2bc452f59dad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:52.413244 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.413224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fztkx\" (UID: \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:52.413423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.413400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04509b3e-3ed9-4240-b72a-2bc452f59dad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-j4hhz\" (UID: \"04509b3e-3ed9-4240-b72a-2bc452f59dad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:52.421911 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.421890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj5gk\" (UniqueName: \"kubernetes.io/projected/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-kube-api-access-wj5gk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fztkx\" (UID: \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:52.421977 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.421937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp8qn\" (UniqueName: \"kubernetes.io/projected/04509b3e-3ed9-4240-b72a-2bc452f59dad-kube-api-access-gp8qn\") pod \"kuadrant-operator-controller-manager-5f685c496f-j4hhz\" (UID: \"04509b3e-3ed9-4240-b72a-2bc452f59dad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:52.455424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.455399    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:52.513774 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.513745    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-extensions-socket-volume\") pod \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\" (UID: \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\") "
Sep 09 12:19:52.513904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.513881    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dkmk\" (UniqueName: \"kubernetes.io/projected/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-kube-api-access-5dkmk\") pod \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\" (UID: \"79423f65-8d9c-4edc-89a0-8f1ae0d6b128\") "
Sep 09 12:19:52.515093 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.515057    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "79423f65-8d9c-4edc-89a0-8f1ae0d6b128" (UID: "79423f65-8d9c-4edc-89a0-8f1ae0d6b128"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:19:52.518214 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.518195    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-kube-api-access-5dkmk" (OuterVolumeSpecName: "kube-api-access-5dkmk") pod "79423f65-8d9c-4edc-89a0-8f1ae0d6b128" (UID: "79423f65-8d9c-4edc-89a0-8f1ae0d6b128"). InnerVolumeSpecName "kube-api-access-5dkmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:19:52.543679 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.543615    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:52.614834 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.614802    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dkmk\" (UniqueName: \"kubernetes.io/projected/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-kube-api-access-5dkmk\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:52.614834 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.614827    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79423f65-8d9c-4edc-89a0-8f1ae0d6b128-extensions-socket-volume\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:19:52.739928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.739902    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"]
Sep 09 12:19:52.741670 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:19:52.741643    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04509b3e_3ed9_4240_b72a_2bc452f59dad.slice/crio-cf4e9d31a2a1cea38b5cfdacc6cde2532930fa2b54b9e032dac65635b1afe2cf WatchSource:0}: Error finding container cf4e9d31a2a1cea38b5cfdacc6cde2532930fa2b54b9e032dac65635b1afe2cf: Status 404 returned error can't find the container with id cf4e9d31a2a1cea38b5cfdacc6cde2532930fa2b54b9e032dac65635b1afe2cf
Sep 09 12:19:52.764187 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.764151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz" event={"ID":"04509b3e-3ed9-4240-b72a-2bc452f59dad","Type":"ContainerStarted","Data":"cf4e9d31a2a1cea38b5cfdacc6cde2532930fa2b54b9e032dac65635b1afe2cf"}
Sep 09 12:19:52.765466 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.765445    2560 generic.go:356] "Generic (PLEG): container finished" podID="79423f65-8d9c-4edc-89a0-8f1ae0d6b128" containerID="7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316" exitCode=0
Sep 09 12:19:52.765549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.765493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-v985v"
Sep 09 12:19:52.765549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.765495    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-xxlgt"
Sep 09 12:19:52.765549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.765536    2560 scope.go:117] "RemoveContainer" containerID="7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316"
Sep 09 12:19:52.780199 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.780180    2560 scope.go:117] "RemoveContainer" containerID="7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316"
Sep 09 12:19:52.780456 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:19:52.780440    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316\": container with ID starting with 7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316 not found: ID does not exist" containerID="7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316"
Sep 09 12:19:52.780524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.780462    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316"} err="failed to get container status \"7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316\": rpc error: code = NotFound desc = could not find container \"7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316\": container with ID starting with 7a796e244191f829c8030f5728047b27fea0a6a18a1db236774e7f17a52c1316 not found: ID does not exist"
Sep 09 12:19:52.819600 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:52.819578    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"]
Sep 09 12:19:52.820786 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:19:52.820761    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a75e6cb_88c3_4f4c_a3bb_0a4d7864bc92.slice/crio-c83e0f34bea0170d157a2124f93e242f91a94d421162d733916629209aa71d54 WatchSource:0}: Error finding container c83e0f34bea0170d157a2124f93e242f91a94d421162d733916629209aa71d54: Status 404 returned error can't find the container with id c83e0f34bea0170d157a2124f93e242f91a94d421162d733916629209aa71d54
Sep 09 12:19:53.282767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.282733    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:53.450443 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.450414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:53.773770 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.773720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx" event={"ID":"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92","Type":"ContainerStarted","Data":"7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e"}
Sep 09 12:19:53.773968 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.773790    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:19:53.773968 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.773817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx" event={"ID":"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92","Type":"ContainerStarted","Data":"c83e0f34bea0170d157a2124f93e242f91a94d421162d733916629209aa71d54"}
Sep 09 12:19:53.775407 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.775384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz" event={"ID":"04509b3e-3ed9-4240-b72a-2bc452f59dad","Type":"ContainerStarted","Data":"95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901"}
Sep 09 12:19:53.775500 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.775432    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:19:53.804206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.804152    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx" podStartSLOduration=1.804138365 podStartE2EDuration="1.804138365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:19:53.803311599 +0000 UTC m=+509.849436773" watchObservedRunningTime="2026-09-09 12:19:53.804138365 +0000 UTC m=+509.850263541"
Sep 09 12:19:53.839311 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:53.835339    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz" podStartSLOduration=1.835319175 podStartE2EDuration="1.835319175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:19:53.833814747 +0000 UTC m=+509.879939927" watchObservedRunningTime="2026-09-09 12:19:53.835319175 +0000 UTC m=+509.881444349"
Sep 09 12:19:54.399169 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:54.399138    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79423f65-8d9c-4edc-89a0-8f1ae0d6b128" path="/var/lib/kubelet/pods/79423f65-8d9c-4edc-89a0-8f1ae0d6b128/volumes"
Sep 09 12:19:55.850966 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:55.850930    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:19:55.950116 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:19:55.950074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:00.471963 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:00.471926    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:00.573679 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:00.573645    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:03.848232 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:03.848203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:03.936146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:03.936113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:04.782756 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:04.782726    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:20:04.782917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:04.782870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:20:04.870945 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:04.870912    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"]
Sep 09 12:20:04.871343 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:04.871146    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx" podUID="9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92" containerName="manager" containerID="cri-o://7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e" gracePeriod=10
Sep 09 12:20:05.107444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.107415    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:20:05.207888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.207862    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-extensions-socket-volume\") pod \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\" (UID: \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\") "
Sep 09 12:20:05.208072 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.207937    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj5gk\" (UniqueName: \"kubernetes.io/projected/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-kube-api-access-wj5gk\") pod \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\" (UID: \"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92\") "
Sep 09 12:20:05.208226 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.208202    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92" (UID: "9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:20:05.209901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.209878    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-kube-api-access-wj5gk" (OuterVolumeSpecName: "kube-api-access-wj5gk") pod "9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92" (UID: "9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92"). InnerVolumeSpecName "kube-api-access-wj5gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:20:05.308634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.308602    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-extensions-socket-volume\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:20:05.308634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.308630    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj5gk\" (UniqueName: \"kubernetes.io/projected/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92-kube-api-access-wj5gk\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:20:05.342427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.342351    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:05.489304 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.489262    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:05.634147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.634040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:05.840089 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.840060    2560 generic.go:356] "Generic (PLEG): container finished" podID="9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92" containerID="7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e" exitCode=0
Sep 09 12:20:05.840282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.840096    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"
Sep 09 12:20:05.840282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.840140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx" event={"ID":"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92","Type":"ContainerDied","Data":"7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e"}
Sep 09 12:20:05.840282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.840185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx" event={"ID":"9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92","Type":"ContainerDied","Data":"c83e0f34bea0170d157a2124f93e242f91a94d421162d733916629209aa71d54"}
Sep 09 12:20:05.840282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.840207    2560 scope.go:117] "RemoveContainer" containerID="7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e"
Sep 09 12:20:05.848831 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.848814    2560 scope.go:117] "RemoveContainer" containerID="7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e"
Sep 09 12:20:05.849070 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:20:05.849053    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e\": container with ID starting with 7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e not found: ID does not exist" containerID="7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e"
Sep 09 12:20:05.849117 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.849077    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e"} err="failed to get container status \"7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e\": rpc error: code = NotFound desc = could not find container \"7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e\": container with ID starting with 7f79a7362b0fb6d5bba5447db155983c2ce67bc76391c15822c1ca60dd79a16e not found: ID does not exist"
Sep 09 12:20:05.866617 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.866591    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"]
Sep 09 12:20:05.873519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:05.873498    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fztkx"]
Sep 09 12:20:06.400264 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:06.400230    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92" path="/var/lib/kubelet/pods/9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92/volumes"
Sep 09 12:20:12.250856 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:12.250821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:12.351978 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:12.351947    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:13.731039 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:13.730995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:13.790973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:13.790946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:14.858097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:14.858061    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:14.961346 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:14.961311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:17.358374 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.358258    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"]
Sep 09 12:20:17.358834 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.358528    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz" podUID="04509b3e-3ed9-4240-b72a-2bc452f59dad" containerName="manager" containerID="cri-o://95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901" gracePeriod=10
Sep 09 12:20:17.608194 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.608166    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:20:17.713507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.713405    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp8qn\" (UniqueName: \"kubernetes.io/projected/04509b3e-3ed9-4240-b72a-2bc452f59dad-kube-api-access-gp8qn\") pod \"04509b3e-3ed9-4240-b72a-2bc452f59dad\" (UID: \"04509b3e-3ed9-4240-b72a-2bc452f59dad\") "
Sep 09 12:20:17.713665 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.713514    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04509b3e-3ed9-4240-b72a-2bc452f59dad-extensions-socket-volume\") pod \"04509b3e-3ed9-4240-b72a-2bc452f59dad\" (UID: \"04509b3e-3ed9-4240-b72a-2bc452f59dad\") "
Sep 09 12:20:17.713885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.713860    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04509b3e-3ed9-4240-b72a-2bc452f59dad-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "04509b3e-3ed9-4240-b72a-2bc452f59dad" (UID: "04509b3e-3ed9-4240-b72a-2bc452f59dad"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:20:17.715567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.715534    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04509b3e-3ed9-4240-b72a-2bc452f59dad-kube-api-access-gp8qn" (OuterVolumeSpecName: "kube-api-access-gp8qn") pod "04509b3e-3ed9-4240-b72a-2bc452f59dad" (UID: "04509b3e-3ed9-4240-b72a-2bc452f59dad"). InnerVolumeSpecName "kube-api-access-gp8qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:20:17.814465 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.814426    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp8qn\" (UniqueName: \"kubernetes.io/projected/04509b3e-3ed9-4240-b72a-2bc452f59dad-kube-api-access-gp8qn\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:20:17.814465 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.814458    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04509b3e-3ed9-4240-b72a-2bc452f59dad-extensions-socket-volume\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:20:17.902612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.902578    2560 generic.go:356] "Generic (PLEG): container finished" podID="04509b3e-3ed9-4240-b72a-2bc452f59dad" containerID="95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901" exitCode=0
Sep 09 12:20:17.902778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.902625    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"
Sep 09 12:20:17.902778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.902629    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz" event={"ID":"04509b3e-3ed9-4240-b72a-2bc452f59dad","Type":"ContainerDied","Data":"95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901"}
Sep 09 12:20:17.902778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.902752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz" event={"ID":"04509b3e-3ed9-4240-b72a-2bc452f59dad","Type":"ContainerDied","Data":"cf4e9d31a2a1cea38b5cfdacc6cde2532930fa2b54b9e032dac65635b1afe2cf"}
Sep 09 12:20:17.902935 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.902781    2560 scope.go:117] "RemoveContainer" containerID="95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901"
Sep 09 12:20:17.911833 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.911817    2560 scope.go:117] "RemoveContainer" containerID="95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901"
Sep 09 12:20:17.912088 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:20:17.912069    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901\": container with ID starting with 95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901 not found: ID does not exist" containerID="95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901"
Sep 09 12:20:17.912137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.912096    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901"} err="failed to get container status \"95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901\": rpc error: code = NotFound desc = could not find container \"95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901\": container with ID starting with 95f889b800933714766f48da9aba77d813792eda197b3d7eb672a910c705a901 not found: ID does not exist"
Sep 09 12:20:17.927651 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.927625    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"]
Sep 09 12:20:17.936605 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:17.936580    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-j4hhz"]
Sep 09 12:20:18.398715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:18.398682    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04509b3e-3ed9-4240-b72a-2bc452f59dad" path="/var/lib/kubelet/pods/04509b3e-3ed9-4240-b72a-2bc452f59dad/volumes"
Sep 09 12:20:20.260883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:20.260848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:20.361698 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:20.361667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:20.657149 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:20.657108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:20.757628 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:20.757594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:21.300344 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.300311    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"]
Sep 09 12:20:21.300836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.300660    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92" containerName="manager"
Sep 09 12:20:21.300836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.300672    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92" containerName="manager"
Sep 09 12:20:21.300836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.300698    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04509b3e-3ed9-4240-b72a-2bc452f59dad" containerName="manager"
Sep 09 12:20:21.300836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.300704    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="04509b3e-3ed9-4240-b72a-2bc452f59dad" containerName="manager"
Sep 09 12:20:21.300836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.300766    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a75e6cb-88c3-4f4c-a3bb-0a4d7864bc92" containerName="manager"
Sep 09 12:20:21.300836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.300777    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="04509b3e-3ed9-4240-b72a-2bc452f59dad" containerName="manager"
Sep 09 12:20:21.302957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.302936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.305423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.305395    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-d7x8q\""
Sep 09 12:20:21.315940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.315915    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"]
Sep 09 12:20:21.326903 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.326872    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:21.345989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.345961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.346147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.346011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65c307a8-b5ff-4541-9501-a8a493b83b17-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.346147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.346034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.346147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.346100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.346271 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.346144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.346271 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.346209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9s8\" (UniqueName: \"kubernetes.io/projected/65c307a8-b5ff-4541-9501-a8a493b83b17-kube-api-access-wm9s8\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.346271 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.346240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.346398 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.346276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.346398 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.346309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65c307a8-b5ff-4541-9501-a8a493b83b17-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9s8\" (UniqueName: \"kubernetes.io/projected/65c307a8-b5ff-4541-9501-a8a493b83b17-kube-api-access-wm9s8\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.447866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.448131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.448131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.447931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.448250 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.448199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.448346 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.448326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65c307a8-b5ff-4541-9501-a8a493b83b17-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.449932 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.449909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.450134 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.450117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.457459 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.457434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65c307a8-b5ff-4541-9501-a8a493b83b17-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.457571 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.457555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9s8\" (UniqueName: \"kubernetes.io/projected/65c307a8-b5ff-4541-9501-a8a493b83b17-kube-api-access-wm9s8\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xmtbs\" (UID: \"65c307a8-b5ff-4541-9501-a8a493b83b17\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.536468 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.536430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:21.613266 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.613228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:21.891831 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.891806    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"]
Sep 09 12:20:21.893657 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:20:21.893631    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c307a8_b5ff_4541_9501_a8a493b83b17.slice/crio-11e41576df68f1812ea1e8599c4ccab5f47e57b9c51137e6eb4c6f7b8ecaa2e4 WatchSource:0}: Error finding container 11e41576df68f1812ea1e8599c4ccab5f47e57b9c51137e6eb4c6f7b8ecaa2e4: Status 404 returned error can't find the container with id 11e41576df68f1812ea1e8599c4ccab5f47e57b9c51137e6eb4c6f7b8ecaa2e4
Sep 09 12:20:21.926800 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:21.926758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" event={"ID":"65c307a8-b5ff-4541-9501-a8a493b83b17","Type":"ContainerStarted","Data":"11e41576df68f1812ea1e8599c4ccab5f47e57b9c51137e6eb4c6f7b8ecaa2e4"}
Sep 09 12:20:24.882111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:24.882077    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:24.885180 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:24.885148    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:20:24.885281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:24.885224    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:20:24.885281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:24.885259    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:20:25.459537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:25.459494    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:25.533498 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:25.533466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:25.950548 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:25.950513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" event={"ID":"65c307a8-b5ff-4541-9501-a8a493b83b17","Type":"ContainerStarted","Data":"89f1933d2fc066f29b580f9913cba10fdb513a2ff80fcfb34ddd570c9a0f444b"}
Sep 09 12:20:25.973221 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:25.973161    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" podStartSLOduration=1.9837729849999999 podStartE2EDuration="4.973145589s" totalImagesPullingTime="2.989372604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:20:25.970813754 +0000 UTC m=+542.016938948" watchObservedRunningTime="2026-09-09 12:20:25.973145589 +0000 UTC m=+542.019270767"
Sep 09 12:20:26.613617 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:26.613577    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:26.618799 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:26.618773    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:26.680650 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:26.680615    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:26.955307 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:26.955212    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:26.956335 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:26.956315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:20:31.928016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:31.927978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:32.037100 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:32.037062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:35.426896 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.426857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:35.427507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.427484    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rp4mm"]
Sep 09 12:20:35.429886 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.429870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:35.432250 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.432229    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bjgb5\""
Sep 09 12:20:35.432381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.432230    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 12:20:35.432381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.432230    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 12:20:35.432381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.432232    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 12:20:35.438410 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.438381    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rp4mm"]
Sep 09 12:20:35.525574 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.525541    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rp4mm"]
Sep 09 12:20:35.539483 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.539453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:35.571368 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.571330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5xmn\" (UniqueName: \"kubernetes.io/projected/23a7fa41-a9ca-4e9b-a503-72f813152206-kube-api-access-x5xmn\") pod \"limitador-limitador-8588749977-rp4mm\" (UID: \"23a7fa41-a9ca-4e9b-a503-72f813152206\") " pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:35.571535 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.571403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a7fa41-a9ca-4e9b-a503-72f813152206-config-file\") pod \"limitador-limitador-8588749977-rp4mm\" (UID: \"23a7fa41-a9ca-4e9b-a503-72f813152206\") " pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:35.597972 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.597931    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:35.672793 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.672754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a7fa41-a9ca-4e9b-a503-72f813152206-config-file\") pod \"limitador-limitador-8588749977-rp4mm\" (UID: \"23a7fa41-a9ca-4e9b-a503-72f813152206\") " pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:35.672983 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.672850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xmn\" (UniqueName: \"kubernetes.io/projected/23a7fa41-a9ca-4e9b-a503-72f813152206-kube-api-access-x5xmn\") pod \"limitador-limitador-8588749977-rp4mm\" (UID: \"23a7fa41-a9ca-4e9b-a503-72f813152206\") " pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:35.673406 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.673386    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a7fa41-a9ca-4e9b-a503-72f813152206-config-file\") pod \"limitador-limitador-8588749977-rp4mm\" (UID: \"23a7fa41-a9ca-4e9b-a503-72f813152206\") " pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:35.681654 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.681595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5xmn\" (UniqueName: \"kubernetes.io/projected/23a7fa41-a9ca-4e9b-a503-72f813152206-kube-api-access-x5xmn\") pod \"limitador-limitador-8588749977-rp4mm\" (UID: \"23a7fa41-a9ca-4e9b-a503-72f813152206\") " pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:35.740775 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.740736    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:35.833467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.833423    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:20:35.836281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.836256    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:35.847841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.847818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:20:35.881106 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.881077    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:20:35.976132 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.976046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1390a4d7-4743-4573-8ed6-4bc6f1ff99c9-config-file\") pod \"limitador-limitador-84994f7ffc-nvmpg\" (UID: \"1390a4d7-4743-4573-8ed6-4bc6f1ff99c9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:35.976132 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:35.976092    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78c6f\" (UniqueName: \"kubernetes.io/projected/1390a4d7-4743-4573-8ed6-4bc6f1ff99c9-kube-api-access-78c6f\") pod \"limitador-limitador-84994f7ffc-nvmpg\" (UID: \"1390a4d7-4743-4573-8ed6-4bc6f1ff99c9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:36.012216 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.012191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rp4mm"]
Sep 09 12:20:36.014425 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:20:36.014397    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a7fa41_a9ca_4e9b_a503_72f813152206.slice/crio-72fbf9a93e31d04beda990481460cb8922e110c4b55643cbc4efe733184fb577 WatchSource:0}: Error finding container 72fbf9a93e31d04beda990481460cb8922e110c4b55643cbc4efe733184fb577: Status 404 returned error can't find the container with id 72fbf9a93e31d04beda990481460cb8922e110c4b55643cbc4efe733184fb577
Sep 09 12:20:36.076851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.076812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1390a4d7-4743-4573-8ed6-4bc6f1ff99c9-config-file\") pod \"limitador-limitador-84994f7ffc-nvmpg\" (UID: \"1390a4d7-4743-4573-8ed6-4bc6f1ff99c9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:36.077051 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.076859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78c6f\" (UniqueName: \"kubernetes.io/projected/1390a4d7-4743-4573-8ed6-4bc6f1ff99c9-kube-api-access-78c6f\") pod \"limitador-limitador-84994f7ffc-nvmpg\" (UID: \"1390a4d7-4743-4573-8ed6-4bc6f1ff99c9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:36.077570 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.077545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1390a4d7-4743-4573-8ed6-4bc6f1ff99c9-config-file\") pod \"limitador-limitador-84994f7ffc-nvmpg\" (UID: \"1390a4d7-4743-4573-8ed6-4bc6f1ff99c9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:36.085884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.085859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78c6f\" (UniqueName: \"kubernetes.io/projected/1390a4d7-4743-4573-8ed6-4bc6f1ff99c9-kube-api-access-78c6f\") pod \"limitador-limitador-84994f7ffc-nvmpg\" (UID: \"1390a4d7-4743-4573-8ed6-4bc6f1ff99c9\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:36.146826 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.146791    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:36.378557 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.378518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:36.418199 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.418173    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:20:36.419879 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:20:36.419854    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1390a4d7_4743_4573_8ed6_4bc6f1ff99c9.slice/crio-cd1bf0942435ab882a117b37ae16e4cd055d5d00ec3b30088b174eb280ff0d1e WatchSource:0}: Error finding container cd1bf0942435ab882a117b37ae16e4cd055d5d00ec3b30088b174eb280ff0d1e: Status 404 returned error can't find the container with id cd1bf0942435ab882a117b37ae16e4cd055d5d00ec3b30088b174eb280ff0d1e
Sep 09 12:20:36.478901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:36.478859    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:37.011825 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:37.011791    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm" event={"ID":"23a7fa41-a9ca-4e9b-a503-72f813152206","Type":"ContainerStarted","Data":"72fbf9a93e31d04beda990481460cb8922e110c4b55643cbc4efe733184fb577"}
Sep 09 12:20:37.013304 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:37.013267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg" event={"ID":"1390a4d7-4743-4573-8ed6-4bc6f1ff99c9","Type":"ContainerStarted","Data":"cd1bf0942435ab882a117b37ae16e4cd055d5d00ec3b30088b174eb280ff0d1e"}
Sep 09 12:20:38.019857 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:38.019816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg" event={"ID":"1390a4d7-4743-4573-8ed6-4bc6f1ff99c9","Type":"ContainerStarted","Data":"7c3bc5f1d34dd7e776048d48dd88f6444c4c7fdafb4c90cfe914645903b557ba"}
Sep 09 12:20:38.020352 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:38.019886    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:38.021466 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:38.021441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm" event={"ID":"23a7fa41-a9ca-4e9b-a503-72f813152206","Type":"ContainerStarted","Data":"b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a"}
Sep 09 12:20:38.021603 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:38.021585    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:38.039042 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:38.038995    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg" podStartSLOduration=1.6174097 podStartE2EDuration="3.038981417s" totalImagesPullingTime="1.421571717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:20:38.036090078 +0000 UTC m=+554.082215255" watchObservedRunningTime="2026-09-09 12:20:38.038981417 +0000 UTC m=+554.085106633"
Sep 09 12:20:38.053350 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:38.053306    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm" podStartSLOduration=1.578578126 podStartE2EDuration="3.053281042s" totalImagesPullingTime="1.474702916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:20:38.051095355 +0000 UTC m=+554.097220536" watchObservedRunningTime="2026-09-09 12:20:38.053281042 +0000 UTC m=+554.099406220"
Sep 09 12:20:49.027968 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.027934    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:49.028463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.028108    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"
Sep 09 12:20:49.093391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.093354    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rp4mm"]
Sep 09 12:20:49.093591 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.093554    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm" podUID="23a7fa41-a9ca-4e9b-a503-72f813152206" containerName="limitador" containerID="cri-o://b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a" gracePeriod=30
Sep 09 12:20:49.645612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.645587    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:49.797121 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.797032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a7fa41-a9ca-4e9b-a503-72f813152206-config-file\") pod \"23a7fa41-a9ca-4e9b-a503-72f813152206\" (UID: \"23a7fa41-a9ca-4e9b-a503-72f813152206\") "
Sep 09 12:20:49.797121 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.797075    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5xmn\" (UniqueName: \"kubernetes.io/projected/23a7fa41-a9ca-4e9b-a503-72f813152206-kube-api-access-x5xmn\") pod \"23a7fa41-a9ca-4e9b-a503-72f813152206\" (UID: \"23a7fa41-a9ca-4e9b-a503-72f813152206\") "
Sep 09 12:20:49.797485 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.797455    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a7fa41-a9ca-4e9b-a503-72f813152206-config-file" (OuterVolumeSpecName: "config-file") pod "23a7fa41-a9ca-4e9b-a503-72f813152206" (UID: "23a7fa41-a9ca-4e9b-a503-72f813152206"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:20:49.799253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.799231    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a7fa41-a9ca-4e9b-a503-72f813152206-kube-api-access-x5xmn" (OuterVolumeSpecName: "kube-api-access-x5xmn") pod "23a7fa41-a9ca-4e9b-a503-72f813152206" (UID: "23a7fa41-a9ca-4e9b-a503-72f813152206"). InnerVolumeSpecName "kube-api-access-x5xmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:20:49.898147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.898112    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23a7fa41-a9ca-4e9b-a503-72f813152206-config-file\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:20:49.898147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:49.898139    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5xmn\" (UniqueName: \"kubernetes.io/projected/23a7fa41-a9ca-4e9b-a503-72f813152206-kube-api-access-x5xmn\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:20:50.083264 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.083230    2560 generic.go:356] "Generic (PLEG): container finished" podID="23a7fa41-a9ca-4e9b-a503-72f813152206" containerID="b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a" exitCode=0
Sep 09 12:20:50.083690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.083273    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm"
Sep 09 12:20:50.083690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.083266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm" event={"ID":"23a7fa41-a9ca-4e9b-a503-72f813152206","Type":"ContainerDied","Data":"b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a"}
Sep 09 12:20:50.083690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.083415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-rp4mm" event={"ID":"23a7fa41-a9ca-4e9b-a503-72f813152206","Type":"ContainerDied","Data":"72fbf9a93e31d04beda990481460cb8922e110c4b55643cbc4efe733184fb577"}
Sep 09 12:20:50.083690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.083438    2560 scope.go:117] "RemoveContainer" containerID="b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a"
Sep 09 12:20:50.092123 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.092109    2560 scope.go:117] "RemoveContainer" containerID="b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a"
Sep 09 12:20:50.092412 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:20:50.092394    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a\": container with ID starting with b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a not found: ID does not exist" containerID="b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a"
Sep 09 12:20:50.092488 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.092425    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a"} err="failed to get container status \"b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a\": rpc error: code = NotFound desc = could not find container \"b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a\": container with ID starting with b519bb5d599fe1494252ca03b8b2f1f3a981ea595711194cd56fa934836ae65a not found: ID does not exist"
Sep 09 12:20:50.105257 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.105233    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rp4mm"]
Sep 09 12:20:50.111951 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.111933    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rp4mm"]
Sep 09 12:20:50.400122 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:50.400029    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a7fa41-a9ca-4e9b-a503-72f813152206" path="/var/lib/kubelet/pods/23a7fa41-a9ca-4e9b-a503-72f813152206/volumes"
Sep 09 12:20:53.414736 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.414702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:53.514746 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.514709    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:53.851003 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.850969    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f6747"]
Sep 09 12:20:53.851379 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.851366    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a7fa41-a9ca-4e9b-a503-72f813152206" containerName="limitador"
Sep 09 12:20:53.851431 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.851381    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a7fa41-a9ca-4e9b-a503-72f813152206" containerName="limitador"
Sep 09 12:20:53.851467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.851447    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a7fa41-a9ca-4e9b-a503-72f813152206" containerName="limitador"
Sep 09 12:20:53.856010 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.855991    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:20:53.858625 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.858601    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 12:20:53.858780 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.858605    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 12:20:53.858780 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.858694    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 12:20:53.860256 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.860237    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-stkpv\""
Sep 09 12:20:53.862655 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.862638    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f6747"]
Sep 09 12:20:53.879846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.879824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:20:53.930729 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.930684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87802ba7-b4a7-48cc-a1fa-d170993a003e-data\") pod \"postgres-69fb4594cf-f6747\" (UID: \"87802ba7-b4a7-48cc-a1fa-d170993a003e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:20:53.930902 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:53.930747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zcqp\" (UniqueName: \"kubernetes.io/projected/87802ba7-b4a7-48cc-a1fa-d170993a003e-kube-api-access-2zcqp\") pod \"postgres-69fb4594cf-f6747\" (UID: \"87802ba7-b4a7-48cc-a1fa-d170993a003e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:20:54.031805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:54.031765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87802ba7-b4a7-48cc-a1fa-d170993a003e-data\") pod \"postgres-69fb4594cf-f6747\" (UID: \"87802ba7-b4a7-48cc-a1fa-d170993a003e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:20:54.031983 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:54.031820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zcqp\" (UniqueName: \"kubernetes.io/projected/87802ba7-b4a7-48cc-a1fa-d170993a003e-kube-api-access-2zcqp\") pod \"postgres-69fb4594cf-f6747\" (UID: \"87802ba7-b4a7-48cc-a1fa-d170993a003e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:20:54.032175 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:54.032155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87802ba7-b4a7-48cc-a1fa-d170993a003e-data\") pod \"postgres-69fb4594cf-f6747\" (UID: \"87802ba7-b4a7-48cc-a1fa-d170993a003e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:20:54.042883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:54.042850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zcqp\" (UniqueName: \"kubernetes.io/projected/87802ba7-b4a7-48cc-a1fa-d170993a003e-kube-api-access-2zcqp\") pod \"postgres-69fb4594cf-f6747\" (UID: \"87802ba7-b4a7-48cc-a1fa-d170993a003e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:20:54.168718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:54.168636    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:20:54.442192 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:54.442169    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f6747"]
Sep 09 12:20:54.444161 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:20:54.444128    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87802ba7_b4a7_48cc_a1fa_d170993a003e.slice/crio-a4c2408ba9040a52a2e6322910521b0305d9b34ac3c0322a387bf0d45a168105 WatchSource:0}: Error finding container a4c2408ba9040a52a2e6322910521b0305d9b34ac3c0322a387bf0d45a168105: Status 404 returned error can't find the container with id a4c2408ba9040a52a2e6322910521b0305d9b34ac3c0322a387bf0d45a168105
Sep 09 12:20:55.110558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:20:55.110516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747" event={"ID":"87802ba7-b4a7-48cc-a1fa-d170993a003e","Type":"ContainerStarted","Data":"a4c2408ba9040a52a2e6322910521b0305d9b34ac3c0322a387bf0d45a168105"}
Sep 09 12:21:00.146836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:00.146800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747" event={"ID":"87802ba7-b4a7-48cc-a1fa-d170993a003e","Type":"ContainerStarted","Data":"24a4fc9e4f21fbf61f2d4e5fce8f79ca224f7fc0da09007214107baca140d209"}
Sep 09 12:21:00.147370 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:00.146954    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:21:00.163990 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:00.163935    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747" podStartSLOduration=2.282778091 podStartE2EDuration="7.163915979s" totalImagesPullingTime="4.881137888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:21:00.163530298 +0000 UTC m=+576.209655477" watchObservedRunningTime="2026-09-09 12:21:00.163915979 +0000 UTC m=+576.210041162"
Sep 09 12:21:06.181993 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:06.181960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f6747"
Sep 09 12:21:06.511252 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:06.511164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:06.607587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:06.607552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:09.894097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:09.894066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:13.246679 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.246646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:13.285157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.285125    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74c8dcf8d-x9b7f"]
Sep 09 12:21:13.290793 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.290768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:13.293723 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.293482    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6fjpd\""
Sep 09 12:21:13.293723 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.293510    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 12:21:13.293723 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.293516    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 12:21:13.293723 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.293489    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 12:21:13.302494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.302470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74c8dcf8d-x9b7f"]
Sep 09 12:21:13.327720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.327689    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:13.408136 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.408103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:13.408317 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.408166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wldf\" (UniqueName: \"kubernetes.io/projected/3489ec59-5a35-420c-9dd5-4853c91ebb37-kube-api-access-8wldf\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:13.408317 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.408234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:13.466477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.466443    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-76gqg"]
Sep 09 12:21:13.470562 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.470542    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.486197 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.486171    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-76gqg"]
Sep 09 12:21:13.508901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.508833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wldf\" (UniqueName: \"kubernetes.io/projected/3489ec59-5a35-420c-9dd5-4853c91ebb37-kube-api-access-8wldf\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:13.508901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.508871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:13.509049 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.508928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:13.509090 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:13.509053    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 12:21:13.509125 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:13.509053    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 09 12:21:13.509125 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:13.509118    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs podName:3489ec59-5a35-420c-9dd5-4853c91ebb37 nodeName:}" failed. No retries permitted until 2026-09-09 12:21:14.009103455 +0000 UTC m=+590.055228611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs") pod "maas-controller-74c8dcf8d-x9b7f" (UID: "3489ec59-5a35-420c-9dd5-4853c91ebb37") : secret "maas-controller-metrics-tls" not found
Sep 09 12:21:13.509197 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:13.509166    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert podName:3489ec59-5a35-420c-9dd5-4853c91ebb37 nodeName:}" failed. No retries permitted until 2026-09-09 12:21:14.009150568 +0000 UTC m=+590.055275724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert") pod "maas-controller-74c8dcf8d-x9b7f" (UID: "3489ec59-5a35-420c-9dd5-4853c91ebb37") : secret "maas-controller-webhook-cert" not found
Sep 09 12:21:13.517840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.517811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wldf\" (UniqueName: \"kubernetes.io/projected/3489ec59-5a35-420c-9dd5-4853c91ebb37-kube-api-access-8wldf\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:13.609922 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.609890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjzl4\" (UniqueName: \"kubernetes.io/projected/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-kube-api-access-zjzl4\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.610086 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.609936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.610086 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.610030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-metrics-certs\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.710456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.710421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-metrics-certs\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.710597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.710576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjzl4\" (UniqueName: \"kubernetes.io/projected/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-kube-api-access-zjzl4\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.710659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.710626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.710744 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:13.710731    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 09 12:21:13.710795 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:13.710785    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert podName:a18f3866-e99a-4bfb-a50f-ef1a158cc5f7 nodeName:}" failed. No retries permitted until 2026-09-09 12:21:14.210769342 +0000 UTC m=+590.256894498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert") pod "maas-controller-bfbcdff9f-76gqg" (UID: "a18f3866-e99a-4bfb-a50f-ef1a158cc5f7") : secret "maas-controller-webhook-cert" not found
Sep 09 12:21:13.712847 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.712830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-metrics-certs\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.720402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.720379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjzl4\" (UniqueName: \"kubernetes.io/projected/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-kube-api-access-zjzl4\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:13.999804 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:13.999760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:14.012730 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.012703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:14.012834 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.012773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:14.012874 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:14.012853    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 09 12:21:14.012937 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:14.012927    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert podName:3489ec59-5a35-420c-9dd5-4853c91ebb37 nodeName:}" failed. No retries permitted until 2026-09-09 12:21:15.01291074 +0000 UTC m=+591.059035897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert") pod "maas-controller-74c8dcf8d-x9b7f" (UID: "3489ec59-5a35-420c-9dd5-4853c91ebb37") : secret "maas-controller-webhook-cert" not found
Sep 09 12:21:14.015113 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.015090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:14.104058 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.104021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:14.215050 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.215007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:14.217594 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.217563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert\") pod \"maas-controller-bfbcdff9f-76gqg\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") " pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:14.380018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.379982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:14.652379 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.652353    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-76gqg"]
Sep 09 12:21:14.653918 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:21:14.653849    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18f3866_e99a_4bfb_a50f_ef1a158cc5f7.slice/crio-ec4229eab63f5ea6470ff7988a366c1c9570504ea3e33993a0329371d1c07574 WatchSource:0}: Error finding container ec4229eab63f5ea6470ff7988a366c1c9570504ea3e33993a0329371d1c07574: Status 404 returned error can't find the container with id ec4229eab63f5ea6470ff7988a366c1c9570504ea3e33993a0329371d1c07574
Sep 09 12:21:14.769231 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:14.769191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:15.021973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:15.021881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:15.024234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:15.024216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert\") pod \"maas-controller-74c8dcf8d-x9b7f\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") " pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:15.110303 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:15.110271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:15.228325 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:15.228274    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-76gqg" event={"ID":"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7","Type":"ContainerStarted","Data":"ec4229eab63f5ea6470ff7988a366c1c9570504ea3e33993a0329371d1c07574"}
Sep 09 12:21:15.387934 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:15.387908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74c8dcf8d-x9b7f"]
Sep 09 12:21:15.390064 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:21:15.390038    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3489ec59_5a35_420c_9dd5_4853c91ebb37.slice/crio-0fb49b4502686f2079099471b658cfc83c480f657c2d50a16015b2ed1051cb73 WatchSource:0}: Error finding container 0fb49b4502686f2079099471b658cfc83c480f657c2d50a16015b2ed1051cb73: Status 404 returned error can't find the container with id 0fb49b4502686f2079099471b658cfc83c480f657c2d50a16015b2ed1051cb73
Sep 09 12:21:16.241192 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:16.241154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f" event={"ID":"3489ec59-5a35-420c-9dd5-4853c91ebb37","Type":"ContainerStarted","Data":"0fb49b4502686f2079099471b658cfc83c480f657c2d50a16015b2ed1051cb73"}
Sep 09 12:21:17.529257 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:17.529215    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:17.631970 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:17.631885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:18.257074 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:18.257032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f" event={"ID":"3489ec59-5a35-420c-9dd5-4853c91ebb37","Type":"ContainerStarted","Data":"e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029"}
Sep 09 12:21:18.257266 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:18.257110    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:18.261849 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:18.261815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-76gqg" event={"ID":"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7","Type":"ContainerStarted","Data":"76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83"}
Sep 09 12:21:18.262009 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:18.261966    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:18.287696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:18.287649    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f" podStartSLOduration=3.316108017 podStartE2EDuration="5.287631061s" totalImagesPullingTime="1.971523044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:21:18.284713835 +0000 UTC m=+594.330839013" watchObservedRunningTime="2026-09-09 12:21:18.287631061 +0000 UTC m=+594.333756240"
Sep 09 12:21:18.327342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:18.327251    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bfbcdff9f-76gqg" podStartSLOduration=2.6255174930000003 podStartE2EDuration="5.327235966s" totalImagesPullingTime="2.701718473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:21:18.326322794 +0000 UTC m=+594.372447974" watchObservedRunningTime="2026-09-09 12:21:18.327235966 +0000 UTC m=+594.373361144"
Sep 09 12:21:24.338372 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:24.338344    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:21:24.342176 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:24.342154    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:21:29.269786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.269755    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:29.270168 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.269823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:21:29.339394 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.339350    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74c8dcf8d-x9b7f"]
Sep 09 12:21:29.339640 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.339602    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f" podUID="3489ec59-5a35-420c-9dd5-4853c91ebb37" containerName="manager" containerID="cri-o://e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029" gracePeriod=30
Sep 09 12:21:29.580974 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.580952    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:29.758882 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.758844    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert\") pod \"3489ec59-5a35-420c-9dd5-4853c91ebb37\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") "
Sep 09 12:21:29.759076 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.758917    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wldf\" (UniqueName: \"kubernetes.io/projected/3489ec59-5a35-420c-9dd5-4853c91ebb37-kube-api-access-8wldf\") pod \"3489ec59-5a35-420c-9dd5-4853c91ebb37\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") "
Sep 09 12:21:29.759076 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.758982    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs\") pod \"3489ec59-5a35-420c-9dd5-4853c91ebb37\" (UID: \"3489ec59-5a35-420c-9dd5-4853c91ebb37\") "
Sep 09 12:21:29.761147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.761117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3489ec59-5a35-420c-9dd5-4853c91ebb37-kube-api-access-8wldf" (OuterVolumeSpecName: "kube-api-access-8wldf") pod "3489ec59-5a35-420c-9dd5-4853c91ebb37" (UID: "3489ec59-5a35-420c-9dd5-4853c91ebb37"). InnerVolumeSpecName "kube-api-access-8wldf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:21:29.761147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.761133    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3489ec59-5a35-420c-9dd5-4853c91ebb37" (UID: "3489ec59-5a35-420c-9dd5-4853c91ebb37"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:21:29.761147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.761115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3489ec59-5a35-420c-9dd5-4853c91ebb37" (UID: "3489ec59-5a35-420c-9dd5-4853c91ebb37"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:21:29.860608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.860534    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:21:29.860608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.860560    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3489ec59-5a35-420c-9dd5-4853c91ebb37-webhook-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:21:29.860608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:29.860570    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wldf\" (UniqueName: \"kubernetes.io/projected/3489ec59-5a35-420c-9dd5-4853c91ebb37-kube-api-access-8wldf\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:21:30.327027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.326991    2560 generic.go:356] "Generic (PLEG): container finished" podID="3489ec59-5a35-420c-9dd5-4853c91ebb37" containerID="e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029" exitCode=0
Sep 09 12:21:30.327613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.327039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f"
Sep 09 12:21:30.327613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.327047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f" event={"ID":"3489ec59-5a35-420c-9dd5-4853c91ebb37","Type":"ContainerDied","Data":"e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029"}
Sep 09 12:21:30.327613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.327094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c8dcf8d-x9b7f" event={"ID":"3489ec59-5a35-420c-9dd5-4853c91ebb37","Type":"ContainerDied","Data":"0fb49b4502686f2079099471b658cfc83c480f657c2d50a16015b2ed1051cb73"}
Sep 09 12:21:30.327613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.327119    2560 scope.go:117] "RemoveContainer" containerID="e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029"
Sep 09 12:21:30.335929 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.335914    2560 scope.go:117] "RemoveContainer" containerID="e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029"
Sep 09 12:21:30.336178 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:21:30.336161    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029\": container with ID starting with e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029 not found: ID does not exist" containerID="e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029"
Sep 09 12:21:30.336263 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.336184    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029"} err="failed to get container status \"e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029\": rpc error: code = NotFound desc = could not find container \"e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029\": container with ID starting with e40c1d11c76faf8e5ba68a6b389321bae7ccc108b8621c115168446da7b25029 not found: ID does not exist"
Sep 09 12:21:30.349758 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.349731    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74c8dcf8d-x9b7f"]
Sep 09 12:21:30.353965 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.353945    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74c8dcf8d-x9b7f"]
Sep 09 12:21:30.398761 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:30.398731    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3489ec59-5a35-420c-9dd5-4853c91ebb37" path="/var/lib/kubelet/pods/3489ec59-5a35-420c-9dd5-4853c91ebb37/volumes"
Sep 09 12:21:39.128667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:39.128627    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:49.152661 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:49.152580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:49.259757 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:49.259714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:50.544813 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.544779    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:50.645687 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.645649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:50.687238 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.687204    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"]
Sep 09 12:21:50.687658 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.687639    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3489ec59-5a35-420c-9dd5-4853c91ebb37" containerName="manager"
Sep 09 12:21:50.687750 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.687660    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3489ec59-5a35-420c-9dd5-4853c91ebb37" containerName="manager"
Sep 09 12:21:50.687804 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.687771    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3489ec59-5a35-420c-9dd5-4853c91ebb37" containerName="manager"
Sep 09 12:21:50.692394 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.692370    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.694846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.694824    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 12:21:50.694967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.694832    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qz8xf\""
Sep 09 12:21:50.694967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.694872    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 12:21:50.700889 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.700243    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"]
Sep 09 12:21:50.728832 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.728802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-openshift-service-ca\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.728971 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.728837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-metrics-certs\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.728971 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.728862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-maas-api-tls\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.728971 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.728909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4jvn\" (UniqueName: \"kubernetes.io/projected/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-kube-api-access-q4jvn\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.769049 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.769009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:50.830259 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.830232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-openshift-service-ca\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.830444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.830267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-metrics-certs\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.830444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.830284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-maas-api-tls\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.830444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.830338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4jvn\" (UniqueName: \"kubernetes.io/projected/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-kube-api-access-q4jvn\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.830966 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.830942    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-openshift-service-ca\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.832715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.832688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-metrics-certs\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.832816 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.832713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-maas-api-tls\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.839604 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.839573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4jvn\" (UniqueName: \"kubernetes.io/projected/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-kube-api-access-q4jvn\") pod \"maas-api-6c5d9d8b4c-qmr7v\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") " pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:50.871148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:50.871122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:51.004487 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:51.004447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:51.146831 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:51.146734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:51.246601 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:51.246569    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:21:51.287405 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:51.287378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"]
Sep 09 12:21:51.289076 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:21:51.289045    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b3821f_1d2d_47e4_bf71_6d07cedf7ff5.slice/crio-9de02937726b23e953165ca95be106eb078fd8b110ed2428a3dafb1b602d3953 WatchSource:0}: Error finding container 9de02937726b23e953165ca95be106eb078fd8b110ed2428a3dafb1b602d3953: Status 404 returned error can't find the container with id 9de02937726b23e953165ca95be106eb078fd8b110ed2428a3dafb1b602d3953
Sep 09 12:21:51.290967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:51.290939    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 12:21:51.336973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:51.336927    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:21:51.437187 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:51.437055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v" event={"ID":"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5","Type":"ContainerStarted","Data":"9de02937726b23e953165ca95be106eb078fd8b110ed2428a3dafb1b602d3953"}
Sep 09 12:21:54.475617 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:54.475582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v" event={"ID":"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5","Type":"ContainerStarted","Data":"b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2"}
Sep 09 12:21:54.475999 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:54.475715    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:21:54.495067 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:21:54.495019    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v" podStartSLOduration=1.771822263 podStartE2EDuration="4.495004613s" totalImagesPullingTime="2.72318235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:21:54.493920775 +0000 UTC m=+630.540045954" watchObservedRunningTime="2026-09-09 12:21:54.495004613 +0000 UTC m=+630.541129791"
Sep 09 12:22:00.488771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:00.488701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:22:00.511986 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:00.511879    2560 generic.go:356] "Generic (PLEG): container finished" podID="65c307a8-b5ff-4541-9501-a8a493b83b17" containerID="89f1933d2fc066f29b580f9913cba10fdb513a2ff80fcfb34ddd570c9a0f444b" exitCode=0
Sep 09 12:22:00.511986 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:00.511958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" event={"ID":"65c307a8-b5ff-4541-9501-a8a493b83b17","Type":"ContainerDied","Data":"89f1933d2fc066f29b580f9913cba10fdb513a2ff80fcfb34ddd570c9a0f444b"}
Sep 09 12:22:00.512397 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:00.512374    2560 scope.go:117] "RemoveContainer" containerID="89f1933d2fc066f29b580f9913cba10fdb513a2ff80fcfb34ddd570c9a0f444b"
Sep 09 12:22:00.513525 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:00.513493    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:22:00.513627 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:00.513571    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:22:00.513692 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:00.513623    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:22:01.520987 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:01.520945    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" event={"ID":"65c307a8-b5ff-4541-9501-a8a493b83b17","Type":"ContainerStarted","Data":"cab9807ee1c8e4468c82af547a1f7267438480722ace1c478a4146bf6d9927dd"}
Sep 09 12:22:01.556677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:01.552734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:01.613944 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:01.613902    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:22:01.614235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:01.614211    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xmtbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 12:22:01.614330 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:01.614263    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" podUID="65c307a8-b5ff-4541-9501-a8a493b83b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 12:22:01.644988 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:01.644946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:02.613737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:02.613694    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xmtbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 12:22:02.614157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:02.613757    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" podUID="65c307a8-b5ff-4541-9501-a8a493b83b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 12:22:03.614180 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:03.614146    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xmtbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 12:22:03.614568 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:03.614198    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" podUID="65c307a8-b5ff-4541-9501-a8a493b83b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 12:22:04.614016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:04.613981    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xmtbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 12:22:04.614205 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:04.614036    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" podUID="65c307a8-b5ff-4541-9501-a8a493b83b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 12:22:05.614057 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.614026    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xmtbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 12:22:05.614236 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.614083    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" podUID="65c307a8-b5ff-4541-9501-a8a493b83b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 12:22:05.726239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.726205    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"]
Sep 09 12:22:05.728970 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.728950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.731565 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.731484    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 12:22:05.731565 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.731534    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 12:22:05.731565 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.731542    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6shtk\""
Sep 09 12:22:05.731814 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.731488    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 12:22:05.748320 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.746728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"]
Sep 09 12:22:05.781862 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.781831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37875b79-b443-4acd-961e-d8bf45e352c0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.782035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.781873    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.782035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.781892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.782035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.781993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.782035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.782020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.782188 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.782048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5lwv\" (UniqueName: \"kubernetes.io/projected/37875b79-b443-4acd-961e-d8bf45e352c0-kube-api-access-c5lwv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.872776 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.872649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:05.882771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.882742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.882771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.882772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.882936 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.882826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.882936 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.882852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.883030 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.882979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5lwv\" (UniqueName: \"kubernetes.io/projected/37875b79-b443-4acd-961e-d8bf45e352c0-kube-api-access-c5lwv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.883093 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.883064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37875b79-b443-4acd-961e-d8bf45e352c0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.883201 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.883159    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.883309 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.883218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.883381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.883347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.885013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.884992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37875b79-b443-4acd-961e-d8bf45e352c0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.885574 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.885552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37875b79-b443-4acd-961e-d8bf45e352c0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:05.891985 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:05.891953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5lwv\" (UniqueName: \"kubernetes.io/projected/37875b79-b443-4acd-961e-d8bf45e352c0-kube-api-access-c5lwv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg\" (UID: \"37875b79-b443-4acd-961e-d8bf45e352c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:06.046139 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:06.046028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:06.111904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:06.111533    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:22:06.325521 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:06.325495    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"]
Sep 09 12:22:06.326751 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:22:06.326724    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37875b79_b443_4acd_961e_d8bf45e352c0.slice/crio-1d334e329bc1450d048b7c1b23baa2da2dfbce54618913b3bc6be2d69fd1a009 WatchSource:0}: Error finding container 1d334e329bc1450d048b7c1b23baa2da2dfbce54618913b3bc6be2d69fd1a009: Status 404 returned error can't find the container with id 1d334e329bc1450d048b7c1b23baa2da2dfbce54618913b3bc6be2d69fd1a009
Sep 09 12:22:06.565842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:06.563052    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg" event={"ID":"37875b79-b443-4acd-961e-d8bf45e352c0","Type":"ContainerStarted","Data":"1d334e329bc1450d048b7c1b23baa2da2dfbce54618913b3bc6be2d69fd1a009"}
Sep 09 12:22:06.614576 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:06.614497    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xmtbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 09 12:22:06.614576 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:06.614559    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs" podUID="65c307a8-b5ff-4541-9501-a8a493b83b17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 09 12:22:07.617927 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:07.617898    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:22:07.618280 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:07.618256    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:22:07.619051 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:07.619034    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xmtbs"
Sep 09 12:22:08.577116 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:08.577077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg" event={"ID":"37875b79-b443-4acd-961e-d8bf45e352c0","Type":"ContainerStarted","Data":"84272173571a837a0912b09ed044ccc77a34aa7ddc3aba21b515e6e220936741"}
Sep 09 12:22:08.598829 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:08.598781    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg" podStartSLOduration=2.398634678 podStartE2EDuration="3.598767238s" totalImagesPullingTime="1.20013256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:22:08.597174956 +0000 UTC m=+644.643300125" watchObservedRunningTime="2026-09-09 12:22:08.598767238 +0000 UTC m=+644.644892416"
Sep 09 12:22:12.529153 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:12.529112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:13.407890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:13.407852    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:22:16.046927 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:16.046888    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:16.047335 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:16.046956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:16.059257 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:16.059233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:16.630477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:16.630447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg"
Sep 09 12:22:23.823612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:23.823574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:24.907827 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:24.907801    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:22:30.803151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.803119    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"]
Sep 09 12:22:30.806489 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.806471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:30.812763 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.812741    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 09 12:22:30.859786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.859752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:30.887643 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.887614    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"]
Sep 09 12:22:30.899500 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.899477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:30.899620 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.899506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:30.899620 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.899530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f21325-1ded-4db8-8669-56ba3047c428-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:30.899620 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.899596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjldd\" (UniqueName: \"kubernetes.io/projected/17f21325-1ded-4db8-8669-56ba3047c428-kube-api-access-fjldd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:30.899728 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.899623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:30.899728 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:30.899659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.000790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.000749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f21325-1ded-4db8-8669-56ba3047c428-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.000790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.000796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjldd\" (UniqueName: \"kubernetes.io/projected/17f21325-1ded-4db8-8669-56ba3047c428-kube-api-access-fjldd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.001006 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.000818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.001006 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.000872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.001006 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.000945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.001006 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.000970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.001363 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.001342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.001436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.001376    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.001436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.001399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.003176 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.003154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f21325-1ded-4db8-8669-56ba3047c428-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.003503 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.003482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f21325-1ded-4db8-8669-56ba3047c428-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.015698 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.015669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjldd\" (UniqueName: \"kubernetes.io/projected/17f21325-1ded-4db8-8669-56ba3047c428-kube-api-access-fjldd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7xx5m\" (UID: \"17f21325-1ded-4db8-8669-56ba3047c428\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.117262 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.117224    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:31.388701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.388670    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"]
Sep 09 12:22:31.390287 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:22:31.390255    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f21325_1ded_4db8_8669_56ba3047c428.slice/crio-3f4316425887595f947f66aab3a1f4c5756ab8c128493e81afe1d8458d96361a WatchSource:0}: Error finding container 3f4316425887595f947f66aab3a1f4c5756ab8c128493e81afe1d8458d96361a: Status 404 returned error can't find the container with id 3f4316425887595f947f66aab3a1f4c5756ab8c128493e81afe1d8458d96361a
Sep 09 12:22:31.699449 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.699411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m" event={"ID":"17f21325-1ded-4db8-8669-56ba3047c428","Type":"ContainerStarted","Data":"cde9488c267143db9ddf5b1a41aeaf1604bc51a41dc1feb57a6350498fb8740b"}
Sep 09 12:22:31.699607 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.699478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m" event={"ID":"17f21325-1ded-4db8-8669-56ba3047c428","Type":"ContainerStarted","Data":"3f4316425887595f947f66aab3a1f4c5756ab8c128493e81afe1d8458d96361a"}
Sep 09 12:22:31.718738 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:31.718687    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m" podStartSLOduration=1.497060103 podStartE2EDuration="1.718669202s" totalImagesPullingTime="221.609099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:22:31.716709561 +0000 UTC m=+667.762834753" watchObservedRunningTime="2026-09-09 12:22:31.718669202 +0000 UTC m=+667.764794381"
Sep 09 12:22:32.116435 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:32.116398    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:22:37.230752 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:37.230711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:38.811732 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:38.811690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:22:41.117501 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:41.117463    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:41.117872 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:41.117535    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:41.130306 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:41.130274    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:41.765758 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:41.765732    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7xx5m"
Sep 09 12:22:47.934466 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:47.934432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:48.035171 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:48.035140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:57.824681 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:57.824631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:22:59.518591 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:22:59.518554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:23:01.211095 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:23:01.211058    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:23:07.822111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:23:07.822059    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:24:07.764972 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:07.764934    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:07.865734 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:07.865697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:09.137537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:09.137498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:09.227346 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:09.227310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:26.580660 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:26.580621    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:26.681209 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:26.681172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:28.212502 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.212462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:28.326734 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.326697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:28.546438 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.546344    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"]
Sep 09 12:24:28.557365 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.557332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.560401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.560370    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e49066-openshift-default-dockercfg-8rmk6\""
Sep 09 12:24:28.563250 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.563225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"]
Sep 09 12:24:28.574050 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.574023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:28.657226 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-certs\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.657452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657230    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istiod-ca-cert\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.657452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-podinfo\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.657452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657333    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq4nq\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-kube-api-access-jq4nq\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.657452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-socket\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.657682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-credential-socket\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.657682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-envoy\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.657682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-data\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.657682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.657579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-token\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.668935 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.668904    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:28.683765 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.683736    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"]
Sep 09 12:24:28.686557 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.686538    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.689234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.689215    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-bc0270-openshift-default-dockercfg-xgx25\""
Sep 09 12:24:28.699512 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.699489    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"]
Sep 09 12:24:28.758122 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-envoy\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.758122 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6526777-4f4a-4272-b54e-58b52b00fa11-istiod-ca-cert\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.758424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-certs\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.758424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758177    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istiod-ca-cert\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.758424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-podinfo\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.758424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq4nq\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-kube-api-access-jq4nq\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.758424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-data\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.758424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-socket\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.758424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-socket\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.758802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-credential-socket\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.758802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjl5j\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-kube-api-access-vjl5j\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.758802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-certs\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.758802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-socket\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.758802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-certs\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.758802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-token\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.758802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-credential-socket\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.759218 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-envoy\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.759218 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-data\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.759218 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-token\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.759218 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-podinfo\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.759218 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.758929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istiod-ca-cert\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.759218 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.759148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-credential-socket\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.759218 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.759184    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-data\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.760953 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.760931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-podinfo\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.761078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.761054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-envoy\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.776431 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.776400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq4nq\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-kube-api-access-jq4nq\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.777852 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.777822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-token\") pod \"e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") " pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.860396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860357    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-data\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860413    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-socket\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-credential-socket\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjl5j\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-kube-api-access-vjl5j\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-certs\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-token\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-podinfo\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-envoy\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6526777-4f4a-4272-b54e-58b52b00fa11-istiod-ca-cert\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-data\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.860851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-credential-socket\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.861109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-socket\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.861109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.860948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-certs\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.861397 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.861375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6526777-4f4a-4272-b54e-58b52b00fa11-istiod-ca-cert\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.863059 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.863030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-envoy\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.863281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.863259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-podinfo\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.869287 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.869267    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjl5j\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-kube-api-access-vjl5j\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.869287 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.869274    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-token\") pod \"e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") " pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:28.870078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.870063    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:28.998021 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:28.997989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:29.150683 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.150651    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"]
Sep 09 12:24:29.151628 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:24:29.151601    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044edf02_2a9b_4bfb_8cc1_67dfb1aad903.slice/crio-200a0c137bd60e568f47d8dd80136146ba7af9d6da61cbeaeded8f901cc66489 WatchSource:0}: Error finding container 200a0c137bd60e568f47d8dd80136146ba7af9d6da61cbeaeded8f901cc66489: Status 404 returned error can't find the container with id 200a0c137bd60e568f47d8dd80136146ba7af9d6da61cbeaeded8f901cc66489
Sep 09 12:24:29.153759 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.153732    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:29.153853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.153795    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:29.153853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.153826    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:29.281651 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.281622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"]
Sep 09 12:24:29.282125 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:24:29.282100    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6526777_4f4a_4272_b54e_58b52b00fa11.slice/crio-0d4db47458502df83de9ea74da677e74a0fde64f180e2ef1ac138c61558326df WatchSource:0}: Error finding container 0d4db47458502df83de9ea74da677e74a0fde64f180e2ef1ac138c61558326df: Status 404 returned error can't find the container with id 0d4db47458502df83de9ea74da677e74a0fde64f180e2ef1ac138c61558326df
Sep 09 12:24:29.284370 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.284337    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:29.284484 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.284413    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:29.284484 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.284463    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:29.353869 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.353831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" event={"ID":"e6526777-4f4a-4272-b54e-58b52b00fa11","Type":"ContainerStarted","Data":"0d4db47458502df83de9ea74da677e74a0fde64f180e2ef1ac138c61558326df"}
Sep 09 12:24:29.355822 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.355799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" event={"ID":"044edf02-2a9b-4bfb-8cc1-67dfb1aad903","Type":"ContainerStarted","Data":"cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50"}
Sep 09 12:24:29.355938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.355850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" event={"ID":"044edf02-2a9b-4bfb-8cc1-67dfb1aad903","Type":"ContainerStarted","Data":"200a0c137bd60e568f47d8dd80136146ba7af9d6da61cbeaeded8f901cc66489"}
Sep 09 12:24:29.375919 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.375862    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" podStartSLOduration=1.37584607 podStartE2EDuration="1.37584607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:24:29.374168772 +0000 UTC m=+785.420293951" watchObservedRunningTime="2026-09-09 12:24:29.37584607 +0000 UTC m=+785.421971248"
Sep 09 12:24:29.871255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:29.871213    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:30.363279 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:30.363243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" event={"ID":"e6526777-4f4a-4272-b54e-58b52b00fa11","Type":"ContainerStarted","Data":"858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1"}
Sep 09 12:24:30.383486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:30.383439    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" podStartSLOduration=2.383424509 podStartE2EDuration="2.383424509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:24:30.383355791 +0000 UTC m=+786.429480970" watchObservedRunningTime="2026-09-09 12:24:30.383424509 +0000 UTC m=+786.429549687"
Sep 09 12:24:30.678767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:30.678663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:30.781248 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:30.781216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:30.876342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:30.876284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:30.998676 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:30.998595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:31.003690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:31.003663    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:31.369783 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:31.369743    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:31.370317 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:31.369795    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:31.370521 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:31.370505    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:31.370720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:31.370705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:31.613993 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:31.613910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:31.720904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:31.720814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:31.817625 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:31.817589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:32.121285 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.121251    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:24:32.605618 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.605582    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:32.750266 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.750232    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"]
Sep 09 12:24:32.753260 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.753238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.755704 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.755509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e49066-serving-cert\""
Sep 09 12:24:32.766590 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.766565    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"]
Sep 09 12:24:32.797933 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.797904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qbnb\" (UniqueName: \"kubernetes.io/projected/b82152e6-acad-46bf-87c3-34a1cf9e1a47-kube-api-access-2qbnb\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.798107 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.797949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-maas-api-tls\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.798107 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.797969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-metrics-certs\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.798221 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.798104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82152e6-acad-46bf-87c3-34a1cf9e1a47-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.899363 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.899252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qbnb\" (UniqueName: \"kubernetes.io/projected/b82152e6-acad-46bf-87c3-34a1cf9e1a47-kube-api-access-2qbnb\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.899553 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.899430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-maas-api-tls\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.899553 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.899464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-metrics-certs\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.899553 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.899519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82152e6-acad-46bf-87c3-34a1cf9e1a47-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.900174 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.900147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82152e6-acad-46bf-87c3-34a1cf9e1a47-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.901967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.901946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-maas-api-tls\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.902118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.902098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-metrics-certs\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:32.910866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:32.910843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qbnb\" (UniqueName: \"kubernetes.io/projected/b82152e6-acad-46bf-87c3-34a1cf9e1a47-kube-api-access-2qbnb\") pod \"maas-api-e2e-inf-a-e49066-7986878897-k2djn\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:33.065905 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:33.065862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:33.344191 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:33.344149    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"]
Sep 09 12:24:33.345541 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:24:33.345515    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82152e6_acad_46bf_87c3_34a1cf9e1a47.slice/crio-d1372aa3eec451bd3856d5ed62955004dbd701668c8cb19cb53689513a381c06 WatchSource:0}: Error finding container d1372aa3eec451bd3856d5ed62955004dbd701668c8cb19cb53689513a381c06: Status 404 returned error can't find the container with id d1372aa3eec451bd3856d5ed62955004dbd701668c8cb19cb53689513a381c06
Sep 09 12:24:33.382899 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:33.382850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn" event={"ID":"b82152e6-acad-46bf-87c3-34a1cf9e1a47","Type":"ContainerStarted","Data":"d1372aa3eec451bd3856d5ed62955004dbd701668c8cb19cb53689513a381c06"}
Sep 09 12:24:34.188857 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.188820    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"]
Sep 09 12:24:34.192985 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.192959    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.195509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.195313    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-c554db-serving-cert\""
Sep 09 12:24:34.199614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.199307    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"]
Sep 09 12:24:34.316606 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.316575    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.316761 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.316610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-metrics-certs\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.316761 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.316639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d926fd0-e167-4225-8457-f823b17d93bb-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.316761 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.316731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5rl9\" (UniqueName: \"kubernetes.io/projected/5d926fd0-e167-4225-8457-f823b17d93bb-kube-api-access-f5rl9\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.417697 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.417668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.417697 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.417700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-metrics-certs\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.417902 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.417728    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d926fd0-e167-4225-8457-f823b17d93bb-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.417902 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.417771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5rl9\" (UniqueName: \"kubernetes.io/projected/5d926fd0-e167-4225-8457-f823b17d93bb-kube-api-access-f5rl9\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.418494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.418470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d926fd0-e167-4225-8457-f823b17d93bb-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.420133 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.420106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-metrics-certs\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.420246 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.420164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.426154 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.426133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5rl9\" (UniqueName: \"kubernetes.io/projected/5d926fd0-e167-4225-8457-f823b17d93bb-kube-api-access-f5rl9\") pod \"maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.434587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.434556    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:34.507926 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.507836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:34.534805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.534770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:34.686433 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.686396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:34.788117 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.788036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:34.799397 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:34.799238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"]
Sep 09 12:24:34.802671 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:24:34.802629    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d926fd0_e167_4225_8457_f823b17d93bb.slice/crio-5a4501c1a08e8a38936b41443529ea5cb9946e1ddd8511922ff030410b2ea1a9 WatchSource:0}: Error finding container 5a4501c1a08e8a38936b41443529ea5cb9946e1ddd8511922ff030410b2ea1a9: Status 404 returned error can't find the container with id 5a4501c1a08e8a38936b41443529ea5cb9946e1ddd8511922ff030410b2ea1a9
Sep 09 12:24:35.112928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.112892    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"]
Sep 09 12:24:35.116597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.116578    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.119246 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.119222    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-bc0270-serving-cert\""
Sep 09 12:24:35.133078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.133050    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"]
Sep 09 12:24:35.183886 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.183852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:35.229587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.229553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-metrics-certs\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.230131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.229601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqqtg\" (UniqueName: \"kubernetes.io/projected/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-kube-api-access-kqqtg\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.230131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.229715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-maas-api-tls\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.230131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.229793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.291055 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.291021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:35.330432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.330394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.330645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.330474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-metrics-certs\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.330645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.330506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqqtg\" (UniqueName: \"kubernetes.io/projected/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-kube-api-access-kqqtg\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.330645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.330577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-maas-api-tls\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.331130 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.331097    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.332974 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.332950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-maas-api-tls\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.333217 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.333200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-metrics-certs\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.338961 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.338932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqqtg\" (UniqueName: \"kubernetes.io/projected/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-kube-api-access-kqqtg\") pod \"maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.374961 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.374868    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:35.394774 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.394741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl" event={"ID":"5d926fd0-e167-4225-8457-f823b17d93bb","Type":"ContainerStarted","Data":"5a4501c1a08e8a38936b41443529ea5cb9946e1ddd8511922ff030410b2ea1a9"}
Sep 09 12:24:35.428021 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.427989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:35.643080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.642986    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:35.708101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.708073    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"]
Sep 09 12:24:35.709344 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:24:35.709314    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc450cfb0_df51_4ae3_b8b2_3f0497b4f581.slice/crio-1fe8a0169ce11f35733b8eb69b82f2be0405b1c4879daeff1d02713e55235bf4 WatchSource:0}: Error finding container 1fe8a0169ce11f35733b8eb69b82f2be0405b1c4879daeff1d02713e55235bf4: Status 404 returned error can't find the container with id 1fe8a0169ce11f35733b8eb69b82f2be0405b1c4879daeff1d02713e55235bf4
Sep 09 12:24:35.712456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:35.712419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:36.041370 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.041284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:36.402175 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.402145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v" event={"ID":"c450cfb0-df51-4ae3-b8b2-3f0497b4f581","Type":"ContainerStarted","Data":"0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7"}
Sep 09 12:24:36.402590 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.402190    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v" event={"ID":"c450cfb0-df51-4ae3-b8b2-3f0497b4f581","Type":"ContainerStarted","Data":"1fe8a0169ce11f35733b8eb69b82f2be0405b1c4879daeff1d02713e55235bf4"}
Sep 09 12:24:36.402590 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.402234    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:36.403826 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.403804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn" event={"ID":"b82152e6-acad-46bf-87c3-34a1cf9e1a47","Type":"ContainerStarted","Data":"12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0"}
Sep 09 12:24:36.403943 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.403868    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:36.419772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.419670    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v" podStartSLOduration=0.966570405 podStartE2EDuration="1.419652297s" totalImagesPullingTime="453.081892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:24:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:24:36.419066701 +0000 UTC m=+792.465191894" watchObservedRunningTime="2026-09-09 12:24:36.419652297 +0000 UTC m=+792.465777478"
Sep 09 12:24:36.440011 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.439956    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn" podStartSLOduration=1.949079961 podStartE2EDuration="4.43994389s" totalImagesPullingTime="2.490863929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:24:36.437482664 +0000 UTC m=+792.483607843" watchObservedRunningTime="2026-09-09 12:24:36.43994389 +0000 UTC m=+792.486069067"
Sep 09 12:24:36.746874 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:36.746781    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:37.410833 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:37.410787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl" event={"ID":"5d926fd0-e167-4225-8457-f823b17d93bb","Type":"ContainerStarted","Data":"d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f"}
Sep 09 12:24:37.411337 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:37.410928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:37.428793 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:37.428739    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl" podStartSLOduration=0.984873649 podStartE2EDuration="3.428725318s" totalImagesPullingTime="2.443851669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:24:37.42753247 +0000 UTC m=+793.473657648" watchObservedRunningTime="2026-09-09 12:24:37.428725318 +0000 UTC m=+793.474850495"
Sep 09 12:24:39.330131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:39.330094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:39.413053 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:39.413015    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:39.516207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:39.516167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:41.142355 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:41.142314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:41.244072 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:41.244017    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:42.315660 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.315626    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"]
Sep 09 12:24:42.318908 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.318884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.321849 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.321510    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c801b865-serving-cert\""
Sep 09 12:24:42.331207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.331182    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"]
Sep 09 12:24:42.375843 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.375813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:42.406790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.406759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-metrics-certs\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.406946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.406802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng657\" (UniqueName: \"kubernetes.io/projected/4b495ab1-ae1e-4539-a768-0a54516f8b76-kube-api-access-ng657\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.406946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.406821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.406946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.406858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b495ab1-ae1e-4539-a768-0a54516f8b76-openshift-service-ca\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.416309 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.416271    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:24:42.416819 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.416796    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:24:42.461849 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.461819    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:42.509926 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.509890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-metrics-certs\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.511194 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.511167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng657\" (UniqueName: \"kubernetes.io/projected/4b495ab1-ae1e-4539-a768-0a54516f8b76-kube-api-access-ng657\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.511901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.511882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.512156 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.512138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b495ab1-ae1e-4539-a768-0a54516f8b76-openshift-service-ca\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.512732 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:24:42.512097    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-serving-cert: secret "maas-api-e2e-ait-c801b865-serving-cert" not found
Sep 09 12:24:42.514462 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:24:42.514447    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls podName:4b495ab1-ae1e-4539-a768-0a54516f8b76 nodeName:}" failed. No retries permitted until 2026-09-09 12:24:43.014423899 +0000 UTC m=+799.060549059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls") pod "maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v" (UID: "4b495ab1-ae1e-4539-a768-0a54516f8b76") : secret "maas-api-e2e-ait-c801b865-serving-cert" not found
Sep 09 12:24:42.514820 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.513727    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b495ab1-ae1e-4539-a768-0a54516f8b76-openshift-service-ca\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.519305 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.519257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-metrics-certs\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.523772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.523747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng657\" (UniqueName: \"kubernetes.io/projected/4b495ab1-ae1e-4539-a768-0a54516f8b76-kube-api-access-ng657\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:42.900452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:42.900409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:43.005204 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:43.005153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:43.018066 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:43.017485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:43.019851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:43.019827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls\") pod \"maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:43.100430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:43.100376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:43.232564 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:43.232352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:43.422694 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:43.422667    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:24:43.590630 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:43.590593    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"]
Sep 09 12:24:43.601793 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:24:43.601760    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b495ab1_ae1e_4539_a768_0a54516f8b76.slice/crio-7fa06316558e6d98738fd6e971e4d2c3ee08f8511516812f55dea2d6247231ed WatchSource:0}: Error finding container 7fa06316558e6d98738fd6e971e4d2c3ee08f8511516812f55dea2d6247231ed: Status 404 returned error can't find the container with id 7fa06316558e6d98738fd6e971e4d2c3ee08f8511516812f55dea2d6247231ed
Sep 09 12:24:44.457771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.457733    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"]
Sep 09 12:24:44.469314 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.465422    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.482312 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.475175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"]
Sep 09 12:24:44.482312 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.475354    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-a1e1f1-serving-cert\""
Sep 09 12:24:44.495374 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.489211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:44.516808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.516781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v" event={"ID":"4b495ab1-ae1e-4539-a768-0a54516f8b76","Type":"ContainerStarted","Data":"7fa06316558e6d98738fd6e971e4d2c3ee08f8511516812f55dea2d6247231ed"}
Sep 09 12:24:44.533399 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.533365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.533541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.533415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-metrics-certs\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.533541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.533447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9b29\" (UniqueName: \"kubernetes.io/projected/efcd1b00-6a52-4b32-92c8-58390d467747-kube-api-access-s9b29\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.533541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.533485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efcd1b00-6a52-4b32-92c8-58390d467747-openshift-service-ca\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.597502 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.597468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:44.634059 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.634024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.634059 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.634066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-metrics-certs\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.634351 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.634091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9b29\" (UniqueName: \"kubernetes.io/projected/efcd1b00-6a52-4b32-92c8-58390d467747-kube-api-access-s9b29\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.634351 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.634119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efcd1b00-6a52-4b32-92c8-58390d467747-openshift-service-ca\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.634351 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:24:44.634165    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-serving-cert: secret "maas-api-e2e-autores-a1e1f1-serving-cert" not found
Sep 09 12:24:44.634351 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:24:44.634223    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls podName:efcd1b00-6a52-4b32-92c8-58390d467747 nodeName:}" failed. No retries permitted until 2026-09-09 12:24:45.134206796 +0000 UTC m=+801.180331957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls") pod "maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8" (UID: "efcd1b00-6a52-4b32-92c8-58390d467747") : secret "maas-api-e2e-autores-a1e1f1-serving-cert" not found
Sep 09 12:24:44.634742 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.634725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efcd1b00-6a52-4b32-92c8-58390d467747-openshift-service-ca\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.641325 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.636611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-metrics-certs\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.664316 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.659920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9b29\" (UniqueName: \"kubernetes.io/projected/efcd1b00-6a52-4b32-92c8-58390d467747-kube-api-access-s9b29\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:44.723844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:44.723748    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:45.136768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:45.136732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:45.139957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:45.139927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:45.156833 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:45.156808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls\") pod \"maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:45.221390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:45.221246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:45.413566 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:45.413475    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:45.590414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:45.584277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:45.737845 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:45.737811    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"]
Sep 09 12:24:45.751108 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:24:45.751060    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefcd1b00_6a52_4b32_92c8_58390d467747.slice/crio-22de578c70390f2739475033a948a63242a08cea72c1af2afb3afa3d2948f969 WatchSource:0}: Error finding container 22de578c70390f2739475033a948a63242a08cea72c1af2afb3afa3d2948f969: Status 404 returned error can't find the container with id 22de578c70390f2739475033a948a63242a08cea72c1af2afb3afa3d2948f969
Sep 09 12:24:46.540038 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:46.539989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v" event={"ID":"4b495ab1-ae1e-4539-a768-0a54516f8b76","Type":"ContainerStarted","Data":"36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a"}
Sep 09 12:24:46.540973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:46.540946    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:46.543388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:46.543358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8" event={"ID":"efcd1b00-6a52-4b32-92c8-58390d467747","Type":"ContainerStarted","Data":"4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e"}
Sep 09 12:24:46.543487 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:46.543411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8" event={"ID":"efcd1b00-6a52-4b32-92c8-58390d467747","Type":"ContainerStarted","Data":"22de578c70390f2739475033a948a63242a08cea72c1af2afb3afa3d2948f969"}
Sep 09 12:24:46.543941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:46.543916    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:46.561170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:46.561110    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v" podStartSLOduration=1.794983186 podStartE2EDuration="4.561093024s" totalImagesPullingTime="2.766109838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:24:46.560585017 +0000 UTC m=+802.606710211" watchObservedRunningTime="2026-09-09 12:24:46.561093024 +0000 UTC m=+802.607218204"
Sep 09 12:24:46.563750 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:46.563718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:46.582009 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:46.581940    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8" podStartSLOduration=2.204851325 podStartE2EDuration="2.581921127s" totalImagesPullingTime="377.069802ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:24:46.57904265 +0000 UTC m=+802.625167832" watchObservedRunningTime="2026-09-09 12:24:46.581921127 +0000 UTC m=+802.628046306"
Sep 09 12:24:47.712883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:47.712845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:47.908423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:47.908314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:47.998998 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:47.998894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:48.099192 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:48.099157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:48.329961 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:48.329920    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:24:49.562935 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:49.562899    2560 generic.go:356] "Generic (PLEG): container finished" podID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerID="cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50" exitCode=0
Sep 09 12:24:49.563322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:49.562965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" event={"ID":"044edf02-2a9b-4bfb-8cc1-67dfb1aad903","Type":"ContainerDied","Data":"cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50"}
Sep 09 12:24:49.563438 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:49.563423    2560 scope.go:117] "RemoveContainer" containerID="cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50"
Sep 09 12:24:49.564630 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:49.564599    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:49.564728 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:49.564674    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:49.564728 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:49.564708    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:50.569846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.569811    2560 generic.go:356] "Generic (PLEG): container finished" podID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerID="858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1" exitCode=0
Sep 09 12:24:50.570370 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.569888    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" event={"ID":"e6526777-4f4a-4272-b54e-58b52b00fa11","Type":"ContainerDied","Data":"858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1"}
Sep 09 12:24:50.570480 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.570462    2560 scope.go:117] "RemoveContainer" containerID="858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1"
Sep 09 12:24:50.571667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.571638    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:50.571790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.571707    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:50.571790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.571741    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:24:50.571923 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.571906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" event={"ID":"044edf02-2a9b-4bfb-8cc1-67dfb1aad903","Type":"ContainerStarted","Data":"3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35"}
Sep 09 12:24:50.870923 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.870838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:50.871067 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.871018    2560 patch_prober.go:28] interesting pod/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 09 12:24:50.871110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.871063    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 09 12:24:50.954042 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:50.954002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:51.589336 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:51.589273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" event={"ID":"e6526777-4f4a-4272-b54e-58b52b00fa11","Type":"ContainerStarted","Data":"20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1"}
Sep 09 12:24:51.871432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:51.871325    2560 patch_prober.go:28] interesting pod/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 09 12:24:51.871432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:51.871397    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 09 12:24:51.998616 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:51.998587    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:51.998798 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:51.998684    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 12:24:51.998798 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:51.998721    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 12:24:52.782148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:52.782056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:52.870889 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:52.870853    2560 patch_prober.go:28] interesting pod/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 09 12:24:52.871162 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:52.871130    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 09 12:24:52.998742 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:52.998698    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 12:24:52.998918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:52.998761    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 12:24:53.570578 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:53.570546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:24:53.596212 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:53.596183    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:24:53.871535 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:53.871434    2560 patch_prober.go:28] interesting pod/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 09 12:24:53.871535 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:53.871506    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 09 12:24:53.999104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:53.999053    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 12:24:53.999262 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:53.999139    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 12:24:54.167426 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:54.167273    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:54.870609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:54.870565    2560 patch_prober.go:28] interesting pod/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 09 12:24:54.870851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:54.870650    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 09 12:24:54.999199 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:54.999155    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 12:24:54.999715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:54.999220    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 12:24:55.276075 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:55.275976    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:55.955205 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:55.955168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:55.999371 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:55.999330    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 12:24:55.999851 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:55.999418    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 12:24:56.018210 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.018174    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:56.018687 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.018664    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:56.019555 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.019526    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:24:56.061743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.061714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:56.219667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.219570    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:56.320417 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.320375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:56.662889 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.662857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:56.842009 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.841973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:56.998667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.998584    2560 patch_prober.go:28] interesting pod/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 12:24:56.998667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:56.998650    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 12:24:57.040262 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:57.040201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:57.148695 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:57.148647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:57.372110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:57.372075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:57.469728 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:57.469697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:57.570518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:57.570481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:58.018625 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:58.018598    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:58.018927 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:58.018896    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:58.019751 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:58.019730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:24:58.050861 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:58.050566    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:58.138875 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:58.138841    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:24:58.927666 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:24:58.927628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:00.908317 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:00.908265    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:01.007461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.007425    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:01.942602 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.942568    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"]
Sep 09 12:25:01.945771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.945745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:01.948418 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.948398    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2a142a-serving-cert\""
Sep 09 12:25:01.957606 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.957581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:01.957742 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.957719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-metrics-certs\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:01.957820 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.957787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a15ba5e-90a8-4cd2-b836-3f00804722a4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:01.957899 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.957836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rt5\" (UniqueName: \"kubernetes.io/projected/9a15ba5e-90a8-4cd2-b836-3f00804722a4-kube-api-access-55rt5\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:01.959126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:01.959106    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"]
Sep 09 12:25:02.023337 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.023286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:02.058716 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.058680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-metrics-certs\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:02.058894 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.058828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a15ba5e-90a8-4cd2-b836-3f00804722a4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:02.058977 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.058879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rt5\" (UniqueName: \"kubernetes.io/projected/9a15ba5e-90a8-4cd2-b836-3f00804722a4-kube-api-access-55rt5\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:02.059095 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.058997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:02.059339 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:25:02.059286    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-serving-cert: secret "maas-api-e2e-inf-b-2a142a-serving-cert" not found
Sep 09 12:25:02.059473 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:25:02.059386    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls podName:9a15ba5e-90a8-4cd2-b836-3f00804722a4 nodeName:}" failed. No retries permitted until 2026-09-09 12:25:02.559364034 +0000 UTC m=+818.605489204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls") pod "maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd" (UID: "9a15ba5e-90a8-4cd2-b836-3f00804722a4") : secret "maas-api-e2e-inf-b-2a142a-serving-cert" not found
Sep 09 12:25:02.060199 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.060169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a15ba5e-90a8-4cd2-b836-3f00804722a4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:02.061906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.061886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-metrics-certs\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:02.071047 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.071026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rt5\" (UniqueName: \"kubernetes.io/projected/9a15ba5e-90a8-4cd2-b836-3f00804722a4-kube-api-access-55rt5\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:02.146915 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.146875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:02.564316 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.564248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:02.564590 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:25:02.564452    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-serving-cert: secret "maas-api-e2e-inf-b-2a142a-serving-cert" not found
Sep 09 12:25:02.564590 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:25:02.564531    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls podName:9a15ba5e-90a8-4cd2-b836-3f00804722a4 nodeName:}" failed. No retries permitted until 2026-09-09 12:25:03.564509861 +0000 UTC m=+819.610635028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls") pod "maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd" (UID: "9a15ba5e-90a8-4cd2-b836-3f00804722a4") : secret "maas-api-e2e-inf-b-2a142a-serving-cert" not found
Sep 09 12:25:02.756959 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.756920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:02.822109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:02.822022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:03.222234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:03.222153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:03.574582 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:03.574545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:03.578323 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:03.577745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:03.620761 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:03.620730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:03.720893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:03.720852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:03.759252 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:03.759223    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:04.035401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:04.035369    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"]
Sep 09 12:25:04.037139 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:25:04.037100    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a15ba5e_90a8_4cd2_b836_3f00804722a4.slice/crio-c4f7c2672d6cf6cbb342302ee331a5f78e8c012bf309aaaea7cb709491e1f258 WatchSource:0}: Error finding container c4f7c2672d6cf6cbb342302ee331a5f78e8c012bf309aaaea7cb709491e1f258: Status 404 returned error can't find the container with id c4f7c2672d6cf6cbb342302ee331a5f78e8c012bf309aaaea7cb709491e1f258
Sep 09 12:25:04.675356 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:04.675326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd" event={"ID":"9a15ba5e-90a8-4cd2-b836-3f00804722a4","Type":"ContainerStarted","Data":"c4f7c2672d6cf6cbb342302ee331a5f78e8c012bf309aaaea7cb709491e1f258"}
Sep 09 12:25:04.861136 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:04.861100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:04.968321 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:04.968218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:05.378558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:05.378519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:05.682982 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:05.682894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd" event={"ID":"9a15ba5e-90a8-4cd2-b836-3f00804722a4","Type":"ContainerStarted","Data":"02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94"}
Sep 09 12:25:05.683389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:05.682999    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:05.703541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:05.703485    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd" podStartSLOduration=4.094865054 podStartE2EDuration="4.703469532s" totalImagesPullingTime="608.604478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:25:05.699717613 +0000 UTC m=+821.745842816" watchObservedRunningTime="2026-09-09 12:25:05.703469532 +0000 UTC m=+821.749594709"
Sep 09 12:25:06.148990 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:06.148953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:07.045365 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:07.045330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:07.755941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:07.755902    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:07.863917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:07.863877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:11.257519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:11.257479    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:11.357730 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:11.357691    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:11.695323 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:11.695281    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:25:15.820184 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:15.820147    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:25:22.663904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:22.663866    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:23.477071 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:23.477038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:24.140122 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.140089    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"]
Sep 09 12:25:24.140753 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.140712    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v" podUID="4b495ab1-ae1e-4539-a768-0a54516f8b76" containerName="maas-api" containerID="cri-o://36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a" gracePeriod=30
Sep 09 12:25:24.172060 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.172019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:24.266380 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.266330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:24.365201 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.365164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:24.406713 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.406601    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:25:24.466045 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.466003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:24.479686 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.479663    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-metrics-certs\") pod \"4b495ab1-ae1e-4539-a768-0a54516f8b76\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") "
Sep 09 12:25:24.479801 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.479774    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b495ab1-ae1e-4539-a768-0a54516f8b76-openshift-service-ca\") pod \"4b495ab1-ae1e-4539-a768-0a54516f8b76\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") "
Sep 09 12:25:24.479844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.479805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng657\" (UniqueName: \"kubernetes.io/projected/4b495ab1-ae1e-4539-a768-0a54516f8b76-kube-api-access-ng657\") pod \"4b495ab1-ae1e-4539-a768-0a54516f8b76\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") "
Sep 09 12:25:24.479844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.479822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls\") pod \"4b495ab1-ae1e-4539-a768-0a54516f8b76\" (UID: \"4b495ab1-ae1e-4539-a768-0a54516f8b76\") "
Sep 09 12:25:24.480205 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.480174    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b495ab1-ae1e-4539-a768-0a54516f8b76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b495ab1-ae1e-4539-a768-0a54516f8b76" (UID: "4b495ab1-ae1e-4539-a768-0a54516f8b76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:25:24.482056 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.482028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4b495ab1-ae1e-4539-a768-0a54516f8b76" (UID: "4b495ab1-ae1e-4539-a768-0a54516f8b76"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:25:24.482146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.482065    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b495ab1-ae1e-4539-a768-0a54516f8b76" (UID: "4b495ab1-ae1e-4539-a768-0a54516f8b76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:25:24.482146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.482081    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b495ab1-ae1e-4539-a768-0a54516f8b76-kube-api-access-ng657" (OuterVolumeSpecName: "kube-api-access-ng657") pod "4b495ab1-ae1e-4539-a768-0a54516f8b76" (UID: "4b495ab1-ae1e-4539-a768-0a54516f8b76"). InnerVolumeSpecName "kube-api-access-ng657". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:25:24.580738 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.580704    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:25:24.580738 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.580739    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b495ab1-ae1e-4539-a768-0a54516f8b76-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:25:24.580992 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.580755    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng657\" (UniqueName: \"kubernetes.io/projected/4b495ab1-ae1e-4539-a768-0a54516f8b76-kube-api-access-ng657\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:25:24.580992 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.580770    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b495ab1-ae1e-4539-a768-0a54516f8b76-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:25:24.581263 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.581237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:24.800422 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.800333    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b495ab1-ae1e-4539-a768-0a54516f8b76" containerID="36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a" exitCode=0
Sep 09 12:25:24.800422 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.800398    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"
Sep 09 12:25:24.800655 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.800421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v" event={"ID":"4b495ab1-ae1e-4539-a768-0a54516f8b76","Type":"ContainerDied","Data":"36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a"}
Sep 09 12:25:24.800655 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.800479    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v" event={"ID":"4b495ab1-ae1e-4539-a768-0a54516f8b76","Type":"ContainerDied","Data":"7fa06316558e6d98738fd6e971e4d2c3ee08f8511516812f55dea2d6247231ed"}
Sep 09 12:25:24.800655 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.800501    2560 scope.go:117] "RemoveContainer" containerID="36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a"
Sep 09 12:25:24.812913 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.812894    2560 scope.go:117] "RemoveContainer" containerID="36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a"
Sep 09 12:25:24.813317 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:25:24.813277    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a\": container with ID starting with 36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a not found: ID does not exist" containerID="36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a"
Sep 09 12:25:24.813427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.813322    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a"} err="failed to get container status \"36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a\": rpc error: code = NotFound desc = could not find container \"36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a\": container with ID starting with 36270b90eb0ddc437446f57f4e83965063010f65f5b8bf8efbc6d86a8d8a666a not found: ID does not exist"
Sep 09 12:25:24.825998 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.825965    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"]
Sep 09 12:25:24.830829 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:24.830809    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c801b865-55dbddf47f-jrn9v"]
Sep 09 12:25:25.085871 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.085752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:25.185942 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.185898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:25.316380 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.316340    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:25.645114 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.645076    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"]
Sep 09 12:25:25.645547 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.645527    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b495ab1-ae1e-4539-a768-0a54516f8b76" containerName="maas-api"
Sep 09 12:25:25.645547 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.645543    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b495ab1-ae1e-4539-a768-0a54516f8b76" containerName="maas-api"
Sep 09 12:25:25.645772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.645660    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b495ab1-ae1e-4539-a768-0a54516f8b76" containerName="maas-api"
Sep 09 12:25:25.648653 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.648635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.650884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.650866    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-669203b2-gw-openshift-default-dockercfg-fbf5h\""
Sep 09 12:25:25.659901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.659881    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"]
Sep 09 12:25:25.691123 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.691083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:25.792427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-credential-socket\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.792602 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-certs\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.792602 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-envoy\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.792602 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-podinfo\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.792711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-socket\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.792711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-token\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.792781 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istiod-ca-cert\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.792781 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c78q\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-kube-api-access-4c78q\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.792843 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.792801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-data\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.893439 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istiod-ca-cert\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.893646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c78q\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-kube-api-access-4c78q\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.893646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-data\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.893646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-credential-socket\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.893646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-certs\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.893895 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-envoy\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.893895 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:25.893895 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-podinfo\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.893895 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-socket\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.894102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.893927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-token\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.894102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.894025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-credential-socket\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.894102 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.894054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-certs\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.894248 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.894116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-data\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.894248 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.894164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istiod-ca-cert\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.894394 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.894373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-socket\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.896579 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.896531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-envoy\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.896689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.896670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-podinfo\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.903901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.903876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-token\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.904035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.904018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c78q\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-kube-api-access-4c78q\") pod \"e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") " pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.960987 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.960953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:25.992046 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:25.992009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:26.241733 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.241705    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"]
Sep 09 12:25:26.243081 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:25:26.243050    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff1ff31_d4b0_4707_ad99_4c68ecfbd337.slice/crio-49f13f722b68fe64d1a42dce07f2bdce7f6861ea88aa344547ebde63fa50a2b3 WatchSource:0}: Error finding container 49f13f722b68fe64d1a42dce07f2bdce7f6861ea88aa344547ebde63fa50a2b3: Status 404 returned error can't find the container with id 49f13f722b68fe64d1a42dce07f2bdce7f6861ea88aa344547ebde63fa50a2b3
Sep 09 12:25:26.245413 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.245384    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:25:26.245519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.245466    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:25:26.245582 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.245513    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:25:26.247940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.247916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:26.400994 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.400965    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b495ab1-ae1e-4539-a768-0a54516f8b76" path="/var/lib/kubelet/pods/4b495ab1-ae1e-4539-a768-0a54516f8b76/volumes"
Sep 09 12:25:26.813698 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.813653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" event={"ID":"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337","Type":"ContainerStarted","Data":"c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6"}
Sep 09 12:25:26.813875 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.813720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" event={"ID":"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337","Type":"ContainerStarted","Data":"49f13f722b68fe64d1a42dce07f2bdce7f6861ea88aa344547ebde63fa50a2b3"}
Sep 09 12:25:26.838471 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.838396    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" podStartSLOduration=1.8383732259999999 podStartE2EDuration="1.838373226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:25:26.835133829 +0000 UTC m=+842.881259011" watchObservedRunningTime="2026-09-09 12:25:26.838373226 +0000 UTC m=+842.884498405"
Sep 09 12:25:26.961411 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.961375    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:26.995812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:26.995775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:27.966967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:27.966938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:28.320839 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.320797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:28.418499 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.418460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:28.512532 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.512498    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"]
Sep 09 12:25:28.515657 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.515632    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.518892 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.518875    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-669203b2-serving-cert\""
Sep 09 12:25:28.529848 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.529824    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"]
Sep 09 12:25:28.550045 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.549999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:28.621347 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.621234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-openshift-service-ca\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.621503 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.621431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-maas-api-tls\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.621503 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.621463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-metrics-certs\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.621503 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.621483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfwpx\" (UniqueName: \"kubernetes.io/projected/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-kube-api-access-qfwpx\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.647751 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.647711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:28.716572 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.716537    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:28.722284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.722255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-maas-api-tls\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.722284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.722286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-metrics-certs\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.722537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.722324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfwpx\" (UniqueName: \"kubernetes.io/projected/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-kube-api-access-qfwpx\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.722537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.722377    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-openshift-service-ca\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.723004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.722979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-openshift-service-ca\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.724651 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.724630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-maas-api-tls\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.724769 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.724669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-metrics-certs\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.734458 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.734430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfwpx\" (UniqueName: \"kubernetes.io/projected/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-kube-api-access-qfwpx\") pod \"maas-api-e2e-migrate-669203b2-dc6654565-85mgd\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:28.825787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.825751    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:28.826582 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.826561    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:28.829754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:28.829719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:29.075214 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:29.075180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:29.122222 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:29.122197    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"]
Sep 09 12:25:29.123183 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:25:29.123162    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0ec4a7_9eb6_4b73_9086_c4e0fab04752.slice/crio-4e70650ccc3bc2400e15393e5b0ccb5869068ebb60585c668d37fbb771f7ca72 WatchSource:0}: Error finding container 4e70650ccc3bc2400e15393e5b0ccb5869068ebb60585c668d37fbb771f7ca72: Status 404 returned error can't find the container with id 4e70650ccc3bc2400e15393e5b0ccb5869068ebb60585c668d37fbb771f7ca72
Sep 09 12:25:29.171640 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:29.171560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:29.832742 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:29.832704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd" event={"ID":"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752","Type":"ContainerStarted","Data":"4e70650ccc3bc2400e15393e5b0ccb5869068ebb60585c668d37fbb771f7ca72"}
Sep 09 12:25:30.841637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:30.841598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd" event={"ID":"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752","Type":"ContainerStarted","Data":"b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276"}
Sep 09 12:25:30.842022 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:30.841682    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:30.869694 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:30.869638    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd" podStartSLOduration=1.896412249 podStartE2EDuration="2.869620705s" totalImagesPullingTime="973.208456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:25:30.867549634 +0000 UTC m=+846.913674876" watchObservedRunningTime="2026-09-09 12:25:30.869620705 +0000 UTC m=+846.915745882"
Sep 09 12:25:33.418856 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:33.418825    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:25:36.864593 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:36.864556    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:43.827377 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:43.827347    2560 patch_prober.go:28] interesting pod/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 12:25:43.827790 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:43.827412    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 12:25:43.933421 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:43.933380    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerID="c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6" exitCode=0
Sep 09 12:25:43.933593 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:43.933445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" event={"ID":"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337","Type":"ContainerDied","Data":"c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6"}
Sep 09 12:25:43.933821 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:43.933805    2560 scope.go:117] "RemoveContainer" containerID="c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6"
Sep 09 12:25:43.935107 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:43.935072    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:25:43.935165 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:43.935146    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:25:43.935206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:43.935188    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:25:44.944543 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:44.944496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" event={"ID":"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337","Type":"ContainerStarted","Data":"bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6"}
Sep 09 12:25:44.961551 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:44.961511    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:45.961487 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:45.961447    2560 patch_prober.go:28] interesting pod/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 12:25:45.961956 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:45.961515    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 12:25:46.962170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:46.961709    2560 patch_prober.go:28] interesting pod/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 12:25:46.962170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:46.961773    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 12:25:47.961760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:47.961718    2560 patch_prober.go:28] interesting pod/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 12:25:47.961930 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:47.961796    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 12:25:48.962308 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:48.962248    2560 patch_prober.go:28] interesting pod/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 12:25:48.962906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:48.962870    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 12:25:49.961692 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:49.961647    2560 patch_prober.go:28] interesting pod/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 12:25:49.961873 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:49.961721    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 12:25:51.094611 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:51.094580    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:51.095361 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:51.094979    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:51.095825 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:51.095805    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:25:52.325384 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:52.325346    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:59.137052 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.137012    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"]
Sep 09 12:25:59.137548 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.137252    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd" podUID="1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" containerName="maas-api" containerID="cri-o://b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276" gracePeriod=30
Sep 09 12:25:59.169781 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.169744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:59.234311 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.234266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:59.299911 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.299872    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:59.377872 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.377839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:59.391859 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.391801    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:25:59.442807 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.442775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:59.496688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.496657    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"]
Sep 09 12:25:59.496925 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.496897    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy" containerID="cri-o://bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6" gracePeriod=30
Sep 09 12:25:59.527894 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.527846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:25:59.530918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.530891    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfwpx\" (UniqueName: \"kubernetes.io/projected/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-kube-api-access-qfwpx\") pod \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") "
Sep 09 12:25:59.531032 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.530951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-metrics-certs\") pod \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") "
Sep 09 12:25:59.531032 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.530992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-openshift-service-ca\") pod \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") "
Sep 09 12:25:59.531126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.531036    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-maas-api-tls\") pod \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\" (UID: \"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752\") "
Sep 09 12:25:59.531402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.531376    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" (UID: "1b0ec4a7-9eb6-4b73-9086-c4e0fab04752"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:25:59.533099 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.533072    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-kube-api-access-qfwpx" (OuterVolumeSpecName: "kube-api-access-qfwpx") pod "1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" (UID: "1b0ec4a7-9eb6-4b73-9086-c4e0fab04752"). InnerVolumeSpecName "kube-api-access-qfwpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:25:59.533345 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.533316    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" (UID: "1b0ec4a7-9eb6-4b73-9086-c4e0fab04752"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:25:59.533525 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.533502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" (UID: "1b0ec4a7-9eb6-4b73-9086-c4e0fab04752"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:25:59.632938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.632898    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:25:59.632938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.632932    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:25:59.632938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.632941    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfwpx\" (UniqueName: \"kubernetes.io/projected/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-kube-api-access-qfwpx\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:25:59.633181 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:25:59.632949    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:00.011741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.011707    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:00.055963 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.055925    2560 generic.go:356] "Generic (PLEG): container finished" podID="1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" containerID="b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276" exitCode=0
Sep 09 12:26:00.056126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.055982    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"
Sep 09 12:26:00.056126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.056009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd" event={"ID":"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752","Type":"ContainerDied","Data":"b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276"}
Sep 09 12:26:00.056126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.056096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd" event={"ID":"1b0ec4a7-9eb6-4b73-9086-c4e0fab04752","Type":"ContainerDied","Data":"4e70650ccc3bc2400e15393e5b0ccb5869068ebb60585c668d37fbb771f7ca72"}
Sep 09 12:26:00.056126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.056123    2560 scope.go:117] "RemoveContainer" containerID="b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276"
Sep 09 12:26:00.065904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.065888    2560 scope.go:117] "RemoveContainer" containerID="b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276"
Sep 09 12:26:00.066163 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:26:00.066145    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276\": container with ID starting with b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276 not found: ID does not exist" containerID="b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276"
Sep 09 12:26:00.066202 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.066173    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276"} err="failed to get container status \"b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276\": rpc error: code = NotFound desc = could not find container \"b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276\": container with ID starting with b90283a9b68400e766c8834e94c8ed8f0c62d0a5dc6d98d90decc0df598ca276 not found: ID does not exist"
Sep 09 12:26:00.079543 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.079512    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"]
Sep 09 12:26:00.083983 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.083951    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-669203b2-dc6654565-85mgd"]
Sep 09 12:26:00.382177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.382125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:00.400597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.400561    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" path="/var/lib/kubelet/pods/1b0ec4a7-9eb6-4b73-9086-c4e0fab04752/volumes"
Sep 09 12:26:00.802639 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:00.802551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:02.603138 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:02.603104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:02.694653 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:02.694615    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:03.722015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.721980    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"]
Sep 09 12:26:03.722450 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.722436    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" containerName="maas-api"
Sep 09 12:26:03.722498 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.722452    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" containerName="maas-api"
Sep 09 12:26:03.722545 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.722536    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b0ec4a7-9eb6-4b73-9086-c4e0fab04752" containerName="maas-api"
Sep 09 12:26:03.724686 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.724672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.727364 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.727343    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8ee5335d-serving-cert\""
Sep 09 12:26:03.734993 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.734973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"]
Sep 09 12:26:03.818845 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.818804    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:03.880079 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.880041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-metrics-certs\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.880269 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.880105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9xb\" (UniqueName: \"kubernetes.io/projected/de78adb1-0687-4bad-9e8f-27915b1f224c-kube-api-access-qq9xb\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.880269 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.880151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de78adb1-0687-4bad-9e8f-27915b1f224c-openshift-service-ca\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.880269 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.880176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.981077 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.980977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de78adb1-0687-4bad-9e8f-27915b1f224c-openshift-service-ca\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.981077 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.981033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.981286 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.981131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-metrics-certs\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.981395 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:26:03.981322    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-serving-cert: secret "maas-api-e2e-ait-8ee5335d-serving-cert" not found
Sep 09 12:26:03.981395 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.981329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9xb\" (UniqueName: \"kubernetes.io/projected/de78adb1-0687-4bad-9e8f-27915b1f224c-kube-api-access-qq9xb\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.981513 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:26:03.981435    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls podName:de78adb1-0687-4bad-9e8f-27915b1f224c nodeName:}" failed. No retries permitted until 2026-09-09 12:26:04.481398765 +0000 UTC m=+880.527523921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls") pod "maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c" (UID: "de78adb1-0687-4bad-9e8f-27915b1f224c") : secret "maas-api-e2e-ait-8ee5335d-serving-cert" not found
Sep 09 12:26:03.981746 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.981718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de78adb1-0687-4bad-9e8f-27915b1f224c-openshift-service-ca\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.983665 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.983645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-metrics-certs\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:03.990588 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:03.990568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9xb\" (UniqueName: \"kubernetes.io/projected/de78adb1-0687-4bad-9e8f-27915b1f224c-kube-api-access-qq9xb\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:04.487337 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.487271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:04.489836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.489772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls\") pod \"maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:04.635694 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.635662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:04.762592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.762566    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:26:04.897612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897573    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c78q\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-kube-api-access-4c78q\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.897612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-podinfo\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.897878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-socket\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.897878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897763    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-certs\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.897878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897831    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-token\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.897878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897864    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-credential-socket\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.898094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897900    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:26:04.898094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897903    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istiod-ca-cert\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.898094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897968    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-envoy\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.898094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.897994    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-data\") pod \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\" (UID: \"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337\") "
Sep 09 12:26:04.898333 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.898136    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:26:04.898333 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.898178    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:26:04.898447 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.898342    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:26:04.898509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.898454    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:04.898509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.898472    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:04.898509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.898485    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:04.898509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.898494    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:04.898717 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.898575    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:26:04.900255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.900231    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:26:04.900255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.900242    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:26:04.900435 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.900336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:26:04.900435 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.900363    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-kube-api-access-4c78q" (OuterVolumeSpecName: "kube-api-access-4c78q") pod "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" (UID: "0ff1ff31-d4b0-4707-ad99-4c68ecfbd337"). InnerVolumeSpecName "kube-api-access-4c78q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:26:04.923942 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.923918    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"]
Sep 09 12:26:04.924717 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:26:04.924694    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde78adb1_0687_4bad_9e8f_27915b1f224c.slice/crio-e5220760aa1b50d0ea949a5dfd2468caf56db54807fca50568f34bdbbd114b41 WatchSource:0}: Error finding container e5220760aa1b50d0ea949a5dfd2468caf56db54807fca50568f34bdbbd114b41: Status 404 returned error can't find the container with id e5220760aa1b50d0ea949a5dfd2468caf56db54807fca50568f34bdbbd114b41
Sep 09 12:26:04.999968 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.999937    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:05.000140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.999973    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:05.000140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:04.999987    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:05.000140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.000000    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c78q\" (UniqueName: \"kubernetes.io/projected/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-kube-api-access-4c78q\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:05.000140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.000014    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:05.088392 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.088354    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerID="bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6" exitCode=0
Sep 09 12:26:05.088597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.088435    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"
Sep 09 12:26:05.088597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.088430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" event={"ID":"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337","Type":"ContainerDied","Data":"bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6"}
Sep 09 12:26:05.088597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.088487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv" event={"ID":"0ff1ff31-d4b0-4707-ad99-4c68ecfbd337","Type":"ContainerDied","Data":"49f13f722b68fe64d1a42dce07f2bdce7f6861ea88aa344547ebde63fa50a2b3"}
Sep 09 12:26:05.088597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.088509    2560 scope.go:117] "RemoveContainer" containerID="bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6"
Sep 09 12:26:05.090104 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.090079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c" event={"ID":"de78adb1-0687-4bad-9e8f-27915b1f224c","Type":"ContainerStarted","Data":"e5220760aa1b50d0ea949a5dfd2468caf56db54807fca50568f34bdbbd114b41"}
Sep 09 12:26:05.100173 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.100155    2560 scope.go:117] "RemoveContainer" containerID="c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6"
Sep 09 12:26:05.109277 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.109255    2560 scope.go:117] "RemoveContainer" containerID="bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6"
Sep 09 12:26:05.109679 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:26:05.109649    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6\": container with ID starting with bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6 not found: ID does not exist" containerID="bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6"
Sep 09 12:26:05.109760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.109690    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6"} err="failed to get container status \"bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6\": rpc error: code = NotFound desc = could not find container \"bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6\": container with ID starting with bbfa614957f1f2ae5f76da659b40a8e2a62ca17889d8524b41ca70e3856284d6 not found: ID does not exist"
Sep 09 12:26:05.109760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.109714    2560 scope.go:117] "RemoveContainer" containerID="c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6"
Sep 09 12:26:05.110005 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:26:05.109989    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6\": container with ID starting with c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6 not found: ID does not exist" containerID="c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6"
Sep 09 12:26:05.110061 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.110008    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6"} err="failed to get container status \"c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6\": rpc error: code = NotFound desc = could not find container \"c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6\": container with ID starting with c85ec8151e6b0e68e52f29f1305082421f30618726c677f9624ca894e4ed57b6 not found: ID does not exist"
Sep 09 12:26:05.112382 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.112347    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"]
Sep 09 12:26:05.114830 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.114811    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-669203b2-gw-openshift-default-557946456-fxwbv"]
Sep 09 12:26:05.497853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.497817    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:05.598336 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.598272    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:05.815980 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:05.815952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:26:06.098395 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:06.098275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c" event={"ID":"de78adb1-0687-4bad-9e8f-27915b1f224c","Type":"ContainerStarted","Data":"ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26"}
Sep 09 12:26:06.098556 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:06.098475    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:06.118244 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:06.118197    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c" podStartSLOduration=2.693385393 podStartE2EDuration="3.118184308s" totalImagesPullingTime="424.798915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:26:06.115517542 +0000 UTC m=+882.161642711" watchObservedRunningTime="2026-09-09 12:26:06.118184308 +0000 UTC m=+882.164309502"
Sep 09 12:26:06.400610 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:06.400531    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" path="/var/lib/kubelet/pods/0ff1ff31-d4b0-4707-ad99-4c68ecfbd337/volumes"
Sep 09 12:26:11.304126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:11.304090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:12.109986 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:12.109959    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:23.421029 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:23.420941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:24.379506 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:24.379478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:26:24.384309 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:24.384278    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:26:29.225557 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:29.225515    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:26:31.312150 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:31.312108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:34.337134 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.337090    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"]
Sep 09 12:26:34.337702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.337363    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c" podUID="de78adb1-0687-4bad-9e8f-27915b1f224c" containerName="maas-api" containerID="cri-o://ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26" gracePeriod=30
Sep 09 12:26:34.359305 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.359260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:34.456889 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.456842    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:34.558861 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.558791    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:34.582232 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.582210    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:34.657867 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.657777    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:34.670926 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.670903    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de78adb1-0687-4bad-9e8f-27915b1f224c-openshift-service-ca\") pod \"de78adb1-0687-4bad-9e8f-27915b1f224c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") "
Sep 09 12:26:34.671054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.670958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-metrics-certs\") pod \"de78adb1-0687-4bad-9e8f-27915b1f224c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") "
Sep 09 12:26:34.671100 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.671061    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq9xb\" (UniqueName: \"kubernetes.io/projected/de78adb1-0687-4bad-9e8f-27915b1f224c-kube-api-access-qq9xb\") pod \"de78adb1-0687-4bad-9e8f-27915b1f224c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") "
Sep 09 12:26:34.671153 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.671113    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls\") pod \"de78adb1-0687-4bad-9e8f-27915b1f224c\" (UID: \"de78adb1-0687-4bad-9e8f-27915b1f224c\") "
Sep 09 12:26:34.671346 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.671315    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de78adb1-0687-4bad-9e8f-27915b1f224c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "de78adb1-0687-4bad-9e8f-27915b1f224c" (UID: "de78adb1-0687-4bad-9e8f-27915b1f224c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:26:34.671427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.671411    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de78adb1-0687-4bad-9e8f-27915b1f224c-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:34.673058 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.673031    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "de78adb1-0687-4bad-9e8f-27915b1f224c" (UID: "de78adb1-0687-4bad-9e8f-27915b1f224c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:26:34.673148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.673071    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "de78adb1-0687-4bad-9e8f-27915b1f224c" (UID: "de78adb1-0687-4bad-9e8f-27915b1f224c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:26:34.673148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.673100    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de78adb1-0687-4bad-9e8f-27915b1f224c-kube-api-access-qq9xb" (OuterVolumeSpecName: "kube-api-access-qq9xb") pod "de78adb1-0687-4bad-9e8f-27915b1f224c" (UID: "de78adb1-0687-4bad-9e8f-27915b1f224c"). InnerVolumeSpecName "kube-api-access-qq9xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:26:34.772729 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.772692    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:34.772729 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.772722    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq9xb\" (UniqueName: \"kubernetes.io/projected/de78adb1-0687-4bad-9e8f-27915b1f224c-kube-api-access-qq9xb\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:34.772729 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:34.772732    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de78adb1-0687-4bad-9e8f-27915b1f224c-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:26:35.277259 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.277223    2560 generic.go:356] "Generic (PLEG): container finished" podID="de78adb1-0687-4bad-9e8f-27915b1f224c" containerID="ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26" exitCode=0
Sep 09 12:26:35.277478 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.277277    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"
Sep 09 12:26:35.277478 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.277324    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c" event={"ID":"de78adb1-0687-4bad-9e8f-27915b1f224c","Type":"ContainerDied","Data":"ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26"}
Sep 09 12:26:35.277478 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.277373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c" event={"ID":"de78adb1-0687-4bad-9e8f-27915b1f224c","Type":"ContainerDied","Data":"e5220760aa1b50d0ea949a5dfd2468caf56db54807fca50568f34bdbbd114b41"}
Sep 09 12:26:35.277478 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.277395    2560 scope.go:117] "RemoveContainer" containerID="ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26"
Sep 09 12:26:35.289255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.289237    2560 scope.go:117] "RemoveContainer" containerID="ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26"
Sep 09 12:26:35.289602 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:26:35.289583    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26\": container with ID starting with ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26 not found: ID does not exist" containerID="ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26"
Sep 09 12:26:35.289656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.289610    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26"} err="failed to get container status \"ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26\": rpc error: code = NotFound desc = could not find container \"ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26\": container with ID starting with ff8a9ff5feb09ffe5ee2508e278b3ddeac5ed4f9c50506ecaf315f736a1b1a26 not found: ID does not exist"
Sep 09 12:26:35.305493 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.305472    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"]
Sep 09 12:26:35.309909 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.309887    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ee5335d-8596f699b8-26q6c"]
Sep 09 12:26:35.821021 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:35.820990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:36.293894 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.293806    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:36.400138 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.400106    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de78adb1-0687-4bad-9e8f-27915b1f224c" path="/var/lib/kubelet/pods/de78adb1-0687-4bad-9e8f-27915b1f224c/volumes"
Sep 09 12:26:36.593203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593172    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"]
Sep 09 12:26:36.593817 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593795    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy"
Sep 09 12:26:36.593885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593821    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy"
Sep 09 12:26:36.593885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593833    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de78adb1-0687-4bad-9e8f-27915b1f224c" containerName="maas-api"
Sep 09 12:26:36.593885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593842    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de78adb1-0687-4bad-9e8f-27915b1f224c" containerName="maas-api"
Sep 09 12:26:36.593885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593874    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy"
Sep 09 12:26:36.593885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593880    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy"
Sep 09 12:26:36.594056 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593946    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy"
Sep 09 12:26:36.594056 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593955    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="de78adb1-0687-4bad-9e8f-27915b1f224c" containerName="maas-api"
Sep 09 12:26:36.594056 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.593963    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff1ff31-d4b0-4707-ad99-4c68ecfbd337" containerName="istio-proxy"
Sep 09 12:26:36.599101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.599081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.601353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.601325    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-e3e6ebae-openshift-default-dockercfg-ktj4q\""
Sep 09 12:26:36.610680 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.610656    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"]
Sep 09 12:26:36.630238 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.630209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:36.696203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5pgg\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-kube-api-access-k5pgg\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.696420 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-certs\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.696420 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-data\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.696420 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696280    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-token\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.696420 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-socket\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.696653 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-podinfo\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.696653 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istiod-ca-cert\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.696653 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-envoy\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.696801 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.696640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-credential-socket\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798238 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5pgg\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-kube-api-access-k5pgg\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798238 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-certs\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-data\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-token\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-socket\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-podinfo\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istiod-ca-cert\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-envoy\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-credential-socket\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798892 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-data\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798892 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-certs\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.798892 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-credential-socket\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.799022 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.798997    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-socket\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.799120 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.799103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istiod-ca-cert\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.801208 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.801175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-envoy\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.801390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.801375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-podinfo\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.806812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.806786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-token\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.807184 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.807167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5pgg\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-kube-api-access-k5pgg\") pod \"e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") " pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:36.858402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.858322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:36.910591 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:36.910565    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:37.192565 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:37.192539    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"]
Sep 09 12:26:37.193977 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:26:37.193939    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ebc0e3_588c_47bc_9a2e_06928feb0ddb.slice/crio-be184d82a74ec475add2b53b73b221e9b54126809746f1ce9dec5ac384127764 WatchSource:0}: Error finding container be184d82a74ec475add2b53b73b221e9b54126809746f1ce9dec5ac384127764: Status 404 returned error can't find the container with id be184d82a74ec475add2b53b73b221e9b54126809746f1ce9dec5ac384127764
Sep 09 12:26:37.196375 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:37.196340    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:26:37.196461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:37.196404    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:26:37.196461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:37.196437    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:26:37.292555 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:37.292499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" event={"ID":"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb","Type":"ContainerStarted","Data":"ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46"}
Sep 09 12:26:37.292737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:37.292584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" event={"ID":"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb","Type":"ContainerStarted","Data":"be184d82a74ec475add2b53b73b221e9b54126809746f1ce9dec5ac384127764"}
Sep 09 12:26:37.316917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:37.316865    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" podStartSLOduration=1.316847546 podStartE2EDuration="1.316847546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:26:37.313624272 +0000 UTC m=+913.359749449" watchObservedRunningTime="2026-09-09 12:26:37.316847546 +0000 UTC m=+913.362972723"
Sep 09 12:26:37.910798 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:37.910762    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:38.916735 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:38.916705    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:39.303998 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.303916    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:39.304776 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.304758    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:26:39.600505 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.600466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:39.764671 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.764640    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"]
Sep 09 12:26:39.769315 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.769278    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:39.772221 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.772188    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-e3e6ebae-serving-cert\""
Sep 09 12:26:39.782513 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.782488    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"]
Sep 09 12:26:39.930745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.930657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6nfk\" (UniqueName: \"kubernetes.io/projected/675147f9-8fd9-46ec-9898-fc48553e9464-kube-api-access-g6nfk\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:39.930745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.930693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/675147f9-8fd9-46ec-9898-fc48553e9464-openshift-service-ca\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:39.930745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.930726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-maas-api-tls\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:39.931176 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.930841    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-metrics-certs\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:39.986017 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:39.985983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:40.031720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.031689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6nfk\" (UniqueName: \"kubernetes.io/projected/675147f9-8fd9-46ec-9898-fc48553e9464-kube-api-access-g6nfk\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.031720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.031729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/675147f9-8fd9-46ec-9898-fc48553e9464-openshift-service-ca\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.031939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.031761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-maas-api-tls\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.031939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.031877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-metrics-certs\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.032525 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.032501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/675147f9-8fd9-46ec-9898-fc48553e9464-openshift-service-ca\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.034337 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.034314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-metrics-certs\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.034460 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.034340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-maas-api-tls\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.040635 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.040608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6nfk\" (UniqueName: \"kubernetes.io/projected/675147f9-8fd9-46ec-9898-fc48553e9464-kube-api-access-g6nfk\") pod \"maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.082485 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.082450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:40.086350 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.086323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:40.310840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.310808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:40.361047 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.361015    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"]
Sep 09 12:26:40.362267 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:26:40.362241    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675147f9_8fd9_46ec_9898_fc48553e9464.slice/crio-00fb758e7af1768aa632490a5b75bfebf08b84569532f05e6e1fd9bcbf07bfca WatchSource:0}: Error finding container 00fb758e7af1768aa632490a5b75bfebf08b84569532f05e6e1fd9bcbf07bfca: Status 404 returned error can't find the container with id 00fb758e7af1768aa632490a5b75bfebf08b84569532f05e6e1fd9bcbf07bfca
Sep 09 12:26:40.413105 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:40.413055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:26:41.317268 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:41.317229    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8" event={"ID":"675147f9-8fd9-46ec-9898-fc48553e9464","Type":"ContainerStarted","Data":"00fb758e7af1768aa632490a5b75bfebf08b84569532f05e6e1fd9bcbf07bfca"}
Sep 09 12:26:43.330669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:43.330621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8" event={"ID":"675147f9-8fd9-46ec-9898-fc48553e9464","Type":"ContainerStarted","Data":"9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6"}
Sep 09 12:26:43.331097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:43.330855    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:43.351766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:43.351715    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8" podStartSLOduration=2.279328541 podStartE2EDuration="4.351700594s" totalImagesPullingTime="2.072372053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:26:43.34971909 +0000 UTC m=+919.395844259" watchObservedRunningTime="2026-09-09 12:26:43.351700594 +0000 UTC m=+919.397825771"
Sep 09 12:26:49.344549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:49.344517    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:26:50.618661 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:50.618630    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:26:56.764770 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:26:56.764729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:00.922820 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:00.922718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:01.445680 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:01.445608    2560 generic.go:356] "Generic (PLEG): container finished" podID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerID="ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46" exitCode=0
Sep 09 12:27:01.445680 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:01.445667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" event={"ID":"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb","Type":"ContainerDied","Data":"ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46"}
Sep 09 12:27:01.448207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:01.446199    2560 scope.go:117] "RemoveContainer" containerID="ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46"
Sep 09 12:27:01.448207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:01.447841    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:01.448207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:01.447935    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:01.448207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:01.447982    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:02.453887 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:02.453849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" event={"ID":"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb","Type":"ContainerStarted","Data":"02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d"}
Sep 09 12:27:02.911743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:02.911700    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:27:02.911957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:02.911828    2560 patch_prober.go:28] interesting pod/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 12:27:02.911957 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:02.911875    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 12:27:02.928557 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:02.928526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:03.911486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:03.911454    2560 patch_prober.go:28] interesting pod/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 12:27:03.911865 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:03.911510    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 12:27:04.911518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:04.911479    2560 patch_prober.go:28] interesting pod/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 12:27:04.912016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:04.911542    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 12:27:05.911440 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:05.911404    2560 patch_prober.go:28] interesting pod/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 12:27:05.911633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:05.911453    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 12:27:06.911700 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:06.911646    2560 patch_prober.go:28] interesting pod/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 12:27:06.912101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:06.911718    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 12:27:06.949127 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:06.949068    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:07.588244 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:07.588210    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"]
Sep 09 12:27:07.588494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:07.588440    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8" podUID="efcd1b00-6a52-4b32-92c8-58390d467747" containerName="maas-api" containerID="cri-o://4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e" gracePeriod=30
Sep 09 12:27:07.627903 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:07.627873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:07.713874 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:07.713845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:07.815947 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:07.815916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:07.892184 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:07.892154    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:27:07.911378 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:07.911344    2560 patch_prober.go:28] interesting pod/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 12:27:07.911487 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:07.911399    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 12:27:08.031914 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.031882    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9b29\" (UniqueName: \"kubernetes.io/projected/efcd1b00-6a52-4b32-92c8-58390d467747-kube-api-access-s9b29\") pod \"efcd1b00-6a52-4b32-92c8-58390d467747\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") "
Sep 09 12:27:08.032436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.031938    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls\") pod \"efcd1b00-6a52-4b32-92c8-58390d467747\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") "
Sep 09 12:27:08.032436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.032010    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-metrics-certs\") pod \"efcd1b00-6a52-4b32-92c8-58390d467747\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") "
Sep 09 12:27:08.032436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.032096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efcd1b00-6a52-4b32-92c8-58390d467747-openshift-service-ca\") pod \"efcd1b00-6a52-4b32-92c8-58390d467747\" (UID: \"efcd1b00-6a52-4b32-92c8-58390d467747\") "
Sep 09 12:27:08.032609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.032539    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efcd1b00-6a52-4b32-92c8-58390d467747-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "efcd1b00-6a52-4b32-92c8-58390d467747" (UID: "efcd1b00-6a52-4b32-92c8-58390d467747"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:27:08.032904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.032881    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efcd1b00-6a52-4b32-92c8-58390d467747-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:08.034669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.034411    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efcd1b00-6a52-4b32-92c8-58390d467747-kube-api-access-s9b29" (OuterVolumeSpecName: "kube-api-access-s9b29") pod "efcd1b00-6a52-4b32-92c8-58390d467747" (UID: "efcd1b00-6a52-4b32-92c8-58390d467747"). InnerVolumeSpecName "kube-api-access-s9b29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:27:08.034669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.034512    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "efcd1b00-6a52-4b32-92c8-58390d467747" (UID: "efcd1b00-6a52-4b32-92c8-58390d467747"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:27:08.034952 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.034930    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "efcd1b00-6a52-4b32-92c8-58390d467747" (UID: "efcd1b00-6a52-4b32-92c8-58390d467747"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:27:08.134522 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.134430    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9b29\" (UniqueName: \"kubernetes.io/projected/efcd1b00-6a52-4b32-92c8-58390d467747-kube-api-access-s9b29\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:08.134522 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.134462    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:08.134522 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.134472    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efcd1b00-6a52-4b32-92c8-58390d467747-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:08.250550 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.250508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:08.378527 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.378481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:08.493799 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.493761    2560 generic.go:356] "Generic (PLEG): container finished" podID="efcd1b00-6a52-4b32-92c8-58390d467747" containerID="4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e" exitCode=0
Sep 09 12:27:08.494004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.493835    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"
Sep 09 12:27:08.494004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.493857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8" event={"ID":"efcd1b00-6a52-4b32-92c8-58390d467747","Type":"ContainerDied","Data":"4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e"}
Sep 09 12:27:08.494004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.493908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8" event={"ID":"efcd1b00-6a52-4b32-92c8-58390d467747","Type":"ContainerDied","Data":"22de578c70390f2739475033a948a63242a08cea72c1af2afb3afa3d2948f969"}
Sep 09 12:27:08.494004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.493936    2560 scope.go:117] "RemoveContainer" containerID="4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e"
Sep 09 12:27:08.504463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.504118    2560 scope.go:117] "RemoveContainer" containerID="4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e"
Sep 09 12:27:08.506726 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:27:08.506698    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e\": container with ID starting with 4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e not found: ID does not exist" containerID="4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e"
Sep 09 12:27:08.506845 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.506733    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e"} err="failed to get container status \"4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e\": rpc error: code = NotFound desc = could not find container \"4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e\": container with ID starting with 4dcf6930e759a312e83d44a979d38ba02fe4216835b78e5698da1be56f74fd2e not found: ID does not exist"
Sep 09 12:27:08.518010 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.517991    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"]
Sep 09 12:27:08.522312 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.522265    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a1e1f1-58cbd6dbdd-8pwz8"]
Sep 09 12:27:08.915385 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.915348    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:27:08.915659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.915636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:27:08.916217 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:08.916200    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:27:09.973111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:09.973075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:10.400656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.400620    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efcd1b00-6a52-4b32-92c8-58390d467747" path="/var/lib/kubelet/pods/efcd1b00-6a52-4b32-92c8-58390d467747/volumes"
Sep 09 12:27:10.580261 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.580226    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"]
Sep 09 12:27:10.580586 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.580522    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8" podUID="675147f9-8fd9-46ec-9898-fc48553e9464" containerName="maas-api" containerID="cri-o://9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6" gracePeriod=30
Sep 09 12:27:10.612546 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.612513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:10.697264 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.697059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:10.771018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.770918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:10.835318 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.835283    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:27:10.848636 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.848604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:10.962713 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.962621    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-maas-api-tls\") pod \"675147f9-8fd9-46ec-9898-fc48553e9464\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") "
Sep 09 12:27:10.962713 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.962688    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-metrics-certs\") pod \"675147f9-8fd9-46ec-9898-fc48553e9464\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") "
Sep 09 12:27:10.962996 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.962717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6nfk\" (UniqueName: \"kubernetes.io/projected/675147f9-8fd9-46ec-9898-fc48553e9464-kube-api-access-g6nfk\") pod \"675147f9-8fd9-46ec-9898-fc48553e9464\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") "
Sep 09 12:27:10.962996 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.962828    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/675147f9-8fd9-46ec-9898-fc48553e9464-openshift-service-ca\") pod \"675147f9-8fd9-46ec-9898-fc48553e9464\" (UID: \"675147f9-8fd9-46ec-9898-fc48553e9464\") "
Sep 09 12:27:10.963496 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.963452    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/675147f9-8fd9-46ec-9898-fc48553e9464-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "675147f9-8fd9-46ec-9898-fc48553e9464" (UID: "675147f9-8fd9-46ec-9898-fc48553e9464"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:27:10.966906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.966326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:10.966906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.966705    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675147f9-8fd9-46ec-9898-fc48553e9464-kube-api-access-g6nfk" (OuterVolumeSpecName: "kube-api-access-g6nfk") pod "675147f9-8fd9-46ec-9898-fc48553e9464" (UID: "675147f9-8fd9-46ec-9898-fc48553e9464"). InnerVolumeSpecName "kube-api-access-g6nfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:27:10.968423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.968264    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "675147f9-8fd9-46ec-9898-fc48553e9464" (UID: "675147f9-8fd9-46ec-9898-fc48553e9464"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:27:10.968423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:10.968305    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "675147f9-8fd9-46ec-9898-fc48553e9464" (UID: "675147f9-8fd9-46ec-9898-fc48553e9464"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:27:11.001604 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.001571    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"]
Sep 09 12:27:11.064369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.064328    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/675147f9-8fd9-46ec-9898-fc48553e9464-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:11.064369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.064364    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:11.064369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.064377    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675147f9-8fd9-46ec-9898-fc48553e9464-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:11.064369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.064390    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6nfk\" (UniqueName: \"kubernetes.io/projected/675147f9-8fd9-46ec-9898-fc48553e9464-kube-api-access-g6nfk\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:11.066017 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.065986    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:11.514391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.514346    2560 generic.go:356] "Generic (PLEG): container finished" podID="675147f9-8fd9-46ec-9898-fc48553e9464" containerID="9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6" exitCode=0
Sep 09 12:27:11.514391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.514382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8" event={"ID":"675147f9-8fd9-46ec-9898-fc48553e9464","Type":"ContainerDied","Data":"9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6"}
Sep 09 12:27:11.514593 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.514418    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"
Sep 09 12:27:11.514593 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.514446    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8" event={"ID":"675147f9-8fd9-46ec-9898-fc48553e9464","Type":"ContainerDied","Data":"00fb758e7af1768aa632490a5b75bfebf08b84569532f05e6e1fd9bcbf07bfca"}
Sep 09 12:27:11.514593 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.514470    2560 scope.go:117] "RemoveContainer" containerID="9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6"
Sep 09 12:27:11.514760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.514728    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy" containerID="cri-o://02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d" gracePeriod=30
Sep 09 12:27:11.524936 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.524921    2560 scope.go:117] "RemoveContainer" containerID="9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6"
Sep 09 12:27:11.525212 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:27:11.525192    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6\": container with ID starting with 9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6 not found: ID does not exist" containerID="9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6"
Sep 09 12:27:11.525261 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.525220    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6"} err="failed to get container status \"9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6\": rpc error: code = NotFound desc = could not find container \"9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6\": container with ID starting with 9f9bf9bf4a66a4c2c2abb0eb3f6519a46f83c4ffe957286cf7993c6f8e750ea6 not found: ID does not exist"
Sep 09 12:27:11.561739 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.561692    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"]
Sep 09 12:27:11.564167 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.564147    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3e6ebae-69c586b647-j2rd8"]
Sep 09 12:27:11.705813 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.705762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:11.805287 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.805254    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:11.906085 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:11.906046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:12.400593 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:12.400560    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="675147f9-8fd9-46ec-9898-fc48553e9464" path="/var/lib/kubelet/pods/675147f9-8fd9-46ec-9898-fc48553e9464/volumes"
Sep 09 12:27:12.612162 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:12.612128    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:27:13.339383 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:13.339334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:13.639432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:13.639348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:14.105668 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:14.105635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:16.770695 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.770672    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:27:16.922358 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922321    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-podinfo\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.922563 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922377    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-data\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.922563 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922483    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-token\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.922563 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istiod-ca-cert\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.922563 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922558    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-envoy\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.922805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922583    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5pgg\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-kube-api-access-k5pgg\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.922805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922627    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-credential-socket\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.922805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922669    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:27:16.922805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922682    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-certs\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.922805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922707    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-socket\") pod \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\" (UID: \"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb\") "
Sep 09 12:27:16.923073 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.922901    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:27:16.923137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.923063    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:27:16.923137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.923073    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:27:16.923262 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.923230    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:16.923341 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.923267    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:16.923341 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.923281    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:16.923341 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.923315    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:16.923510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.923469    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:27:16.924748 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.924718    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:27:16.924841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.924748    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-kube-api-access-k5pgg" (OuterVolumeSpecName: "kube-api-access-k5pgg") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "kube-api-access-k5pgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:27:16.924947 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.924931    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:27:16.924993 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:16.924942    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" (UID: "d4ebc0e3-588c-47bc-9a2e-06928feb0ddb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:27:17.024239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.024202    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5pgg\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-kube-api-access-k5pgg\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:17.024239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.024230    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:17.024239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.024240    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:17.024239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.024248    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:17.024518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.024256    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:27:17.552667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.552635    2560 generic.go:356] "Generic (PLEG): container finished" podID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerID="02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d" exitCode=0
Sep 09 12:27:17.552853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.552683    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"
Sep 09 12:27:17.552853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.552735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" event={"ID":"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb","Type":"ContainerDied","Data":"02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d"}
Sep 09 12:27:17.552853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.552785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7" event={"ID":"d4ebc0e3-588c-47bc-9a2e-06928feb0ddb","Type":"ContainerDied","Data":"be184d82a74ec475add2b53b73b221e9b54126809746f1ce9dec5ac384127764"}
Sep 09 12:27:17.552853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.552818    2560 scope.go:117] "RemoveContainer" containerID="02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d"
Sep 09 12:27:17.562859 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.562838    2560 scope.go:117] "RemoveContainer" containerID="ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46"
Sep 09 12:27:17.570962 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.570943    2560 scope.go:117] "RemoveContainer" containerID="02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d"
Sep 09 12:27:17.571221 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:27:17.571200    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d\": container with ID starting with 02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d not found: ID does not exist" containerID="02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d"
Sep 09 12:27:17.571310 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.571233    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d"} err="failed to get container status \"02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d\": rpc error: code = NotFound desc = could not find container \"02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d\": container with ID starting with 02afc1cdbf76fa22d634b4aab2c17d76646c0d3a30d7e75da3ee88ab60d3567d not found: ID does not exist"
Sep 09 12:27:17.571310 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.571258    2560 scope.go:117] "RemoveContainer" containerID="ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46"
Sep 09 12:27:17.571534 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:27:17.571512    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46\": container with ID starting with ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46 not found: ID does not exist" containerID="ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46"
Sep 09 12:27:17.571581 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.571540    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46"} err="failed to get container status \"ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46\": rpc error: code = NotFound desc = could not find container \"ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46\": container with ID starting with ee41214e48ca7be3bff2af39d751640ec7b14813542efcccb0234a5abd878f46 not found: ID does not exist"
Sep 09 12:27:17.577112 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.577090    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"]
Sep 09 12:27:17.583030 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:17.583008    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-e3e6ebae-openshift-default-5964688b68-ckqb7"]
Sep 09 12:27:18.400206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:18.400176    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" path="/var/lib/kubelet/pods/d4ebc0e3-588c-47bc-9a2e-06928feb0ddb/volumes"
Sep 09 12:27:18.451316 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:18.451277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:19.427086 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:19.427047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:19.487649 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:19.487614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:19.571276 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:19.571246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:19.670654 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:19.670621    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:19.770783 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:19.770692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:20.165754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:20.165721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:21.422186 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:21.422152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:21.522733 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:21.522696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:21.707415 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:21.707325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:22.176221 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.176180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:22.488419 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.488326    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"]
Sep 09 12:27:22.488963 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.488942    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy"
Sep 09 12:27:22.489053 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.488966    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy"
Sep 09 12:27:22.489053 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.488993    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="675147f9-8fd9-46ec-9898-fc48553e9464" containerName="maas-api"
Sep 09 12:27:22.489053 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489002    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="675147f9-8fd9-46ec-9898-fc48553e9464" containerName="maas-api"
Sep 09 12:27:22.489053 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489022    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy"
Sep 09 12:27:22.489053 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489030    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy"
Sep 09 12:27:22.489322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489055    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efcd1b00-6a52-4b32-92c8-58390d467747" containerName="maas-api"
Sep 09 12:27:22.489322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489064    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="efcd1b00-6a52-4b32-92c8-58390d467747" containerName="maas-api"
Sep 09 12:27:22.489322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489166    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="efcd1b00-6a52-4b32-92c8-58390d467747" containerName="maas-api"
Sep 09 12:27:22.489322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489178    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy"
Sep 09 12:27:22.489322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489188    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ebc0e3-588c-47bc-9a2e-06928feb0ddb" containerName="istio-proxy"
Sep 09 12:27:22.489322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.489198    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="675147f9-8fd9-46ec-9898-fc48553e9464" containerName="maas-api"
Sep 09 12:27:22.491378 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.491356    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.494041 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.494021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-b402ba-openshift-default-dockercfg-98lsj\""
Sep 09 12:27:22.510940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.510910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"]
Sep 09 12:27:22.525619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.525589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:22.678035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-podinfo\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.678035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-envoy\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.678236 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-data\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.678236 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qfh8\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-kube-api-access-2qfh8\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.678236 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-token\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.678381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-socket\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.678381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-credential-socket\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.678446 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istiod-ca-cert\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.678446 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.678442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-certs\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.779634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.779554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istiod-ca-cert\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.779634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.779597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-certs\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.779634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.779629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-podinfo\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.779847 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.779727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-envoy\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.779847 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.779766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-data\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.779847 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.779812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qfh8\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-kube-api-access-2qfh8\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.779983 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.779945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-token\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.780036 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.779997    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-certs\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.780095 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.780071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-data\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.780146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.780091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-socket\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.780146 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.780126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-credential-socket\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.780446 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.780423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istiod-ca-cert\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.780530 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.780442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-socket\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.780530 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.780492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-credential-socket\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.782045 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.782021    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-envoy\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.782203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.782187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-podinfo\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.788842 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.788817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-token\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.789236 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.789215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qfh8\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-kube-api-access-2qfh8\") pod \"e2e-explicit-b402ba-openshift-default-f98698564-wv4kg\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") " pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.802096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.802075    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:22.915171 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:22.915137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:23.084802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:23.084775    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"]
Sep 09 12:27:23.086421 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:27:23.086392    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abcd47c_289a_48cc_ad0a_d4a3adf33fc1.slice/crio-5c943293bd25c99bb9c692007e61726245b94a52288c321da598a751d78df318 WatchSource:0}: Error finding container 5c943293bd25c99bb9c692007e61726245b94a52288c321da598a751d78df318: Status 404 returned error can't find the container with id 5c943293bd25c99bb9c692007e61726245b94a52288c321da598a751d78df318
Sep 09 12:27:23.088689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:23.088658    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:23.088770 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:23.088734    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:23.088770 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:23.088761    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:23.592237 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:23.592192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" event={"ID":"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1","Type":"ContainerStarted","Data":"6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674"}
Sep 09 12:27:23.592666 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:23.592258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" event={"ID":"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1","Type":"ContainerStarted","Data":"5c943293bd25c99bb9c692007e61726245b94a52288c321da598a751d78df318"}
Sep 09 12:27:23.617413 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:23.617368    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" podStartSLOduration=1.617352831 podStartE2EDuration="1.617352831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:27:23.616348153 +0000 UTC m=+959.662473334" watchObservedRunningTime="2026-09-09 12:27:23.617352831 +0000 UTC m=+959.663478008"
Sep 09 12:27:23.802399 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:23.802367    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:24.807326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:24.807273    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:25.564287 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:25.564234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:25.604200 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:25.604170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:25.605086 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:25.605064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:25.664417 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:25.664384    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:26.702665 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.702634    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"]
Sep 09 12:27:26.706524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.706490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.709076 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.709050    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-b402ba-serving-cert\""
Sep 09 12:27:26.710689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.710663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.710947 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.710920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45rd4\" (UniqueName: \"kubernetes.io/projected/eacb694b-dfee-4d85-a037-20a71962ceee-kube-api-access-45rd4\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.711072 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.710984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eacb694b-dfee-4d85-a037-20a71962ceee-openshift-service-ca\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.711138 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.711103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-metrics-certs\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.719499 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.719468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"]
Sep 09 12:27:26.755165 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.755126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:26.811863 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.811827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eacb694b-dfee-4d85-a037-20a71962ceee-openshift-service-ca\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.812255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.812223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-metrics-certs\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.812539 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.812517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.812710 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.812689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45rd4\" (UniqueName: \"kubernetes.io/projected/eacb694b-dfee-4d85-a037-20a71962ceee-kube-api-access-45rd4\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.813232 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:27:26.813202    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-serving-cert: secret "maas-api-e2e-explicit-b402ba-serving-cert" not found
Sep 09 12:27:26.813445 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:27:26.813430    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls podName:eacb694b-dfee-4d85-a037-20a71962ceee nodeName:}" failed. No retries permitted until 2026-09-09 12:27:27.313406386 +0000 UTC m=+963.359531561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls") pod "maas-api-e2e-explicit-b402ba-865f7b544f-4wx82" (UID: "eacb694b-dfee-4d85-a037-20a71962ceee") : secret "maas-api-e2e-explicit-b402ba-serving-cert" not found
Sep 09 12:27:26.820656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.820002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-metrics-certs\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.820656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.820545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eacb694b-dfee-4d85-a037-20a71962ceee-openshift-service-ca\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.825098 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.825066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45rd4\" (UniqueName: \"kubernetes.io/projected/eacb694b-dfee-4d85-a037-20a71962ceee-kube-api-access-45rd4\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:26.851196 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:26.851158    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:27.229121 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:27.229088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:27.318009 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:27.317969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:27.318158 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:27:27.318121    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-serving-cert: secret "maas-api-e2e-explicit-b402ba-serving-cert" not found
Sep 09 12:27:27.318213 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:27:27.318194    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls podName:eacb694b-dfee-4d85-a037-20a71962ceee nodeName:}" failed. No retries permitted until 2026-09-09 12:27:28.318179052 +0000 UTC m=+964.364304208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls") pod "maas-api-e2e-explicit-b402ba-865f7b544f-4wx82" (UID: "eacb694b-dfee-4d85-a037-20a71962ceee") : secret "maas-api-e2e-explicit-b402ba-serving-cert" not found
Sep 09 12:27:27.327960 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:27.327929    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:27.464871 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:27.464840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:28.326157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:28.326125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:28.328535 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:28.328516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls\") pod \"maas-api-e2e-explicit-b402ba-865f7b544f-4wx82\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:28.521727 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:28.521695    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:28.792973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:28.792943    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"]
Sep 09 12:27:28.794446 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:27:28.794420    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacb694b_dfee_4d85_a037_20a71962ceee.slice/crio-5fdcf12e54a403d50cc577a4f5dee8cdb824010bf6bcd41893e18257169b75b2 WatchSource:0}: Error finding container 5fdcf12e54a403d50cc577a4f5dee8cdb824010bf6bcd41893e18257169b75b2: Status 404 returned error can't find the container with id 5fdcf12e54a403d50cc577a4f5dee8cdb824010bf6bcd41893e18257169b75b2
Sep 09 12:27:28.795918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:28.795902    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 12:27:29.414245 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:29.414214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:27:29.629330 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:29.629271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82" event={"ID":"eacb694b-dfee-4d85-a037-20a71962ceee","Type":"ContainerStarted","Data":"87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c"}
Sep 09 12:27:29.629519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:29.629352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:29.629519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:29.629374    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82" event={"ID":"eacb694b-dfee-4d85-a037-20a71962ceee","Type":"ContainerStarted","Data":"5fdcf12e54a403d50cc577a4f5dee8cdb824010bf6bcd41893e18257169b75b2"}
Sep 09 12:27:29.648062 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:29.648013    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82" podStartSLOduration=3.155597974 podStartE2EDuration="3.647997581s" totalImagesPullingTime="492.399607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:27:29.644914049 +0000 UTC m=+965.691039226" watchObservedRunningTime="2026-09-09 12:27:29.647997581 +0000 UTC m=+965.694122757"
Sep 09 12:27:35.320232 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:35.320188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:35.641816 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:35.641740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:27:43.314310 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:43.312124    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:27:45.621456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:45.621419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:46.172994 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:46.172881    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:46.739978 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:46.739942    2560 generic.go:356] "Generic (PLEG): container finished" podID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerID="6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674" exitCode=0
Sep 09 12:27:46.740373 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:46.739991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" event={"ID":"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1","Type":"ContainerDied","Data":"6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674"}
Sep 09 12:27:46.740453 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:46.740432    2560 scope.go:117] "RemoveContainer" containerID="6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674"
Sep 09 12:27:46.741555 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:46.741527    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:46.741656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:46.741597    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:46.741656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:46.741627    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:27:47.753018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:47.752975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" event={"ID":"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1","Type":"ContainerStarted","Data":"dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd"}
Sep 09 12:27:47.803206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:47.803170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:47.803423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:47.803395    2560 patch_prober.go:28] interesting pod/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 12:27:47.803503 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:47.803447    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 12:27:48.803028 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:48.802989    2560 patch_prober.go:28] interesting pod/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 12:27:48.803455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:48.803056    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 12:27:49.802871 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:49.802831    2560 patch_prober.go:28] interesting pod/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 12:27:49.803080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:49.802900    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 12:27:50.594479 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:50.594442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:50.802973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:50.802937    2560 patch_prober.go:28] interesting pod/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 12:27:50.803155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:50.802993    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 12:27:51.802364 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:51.802330    2560 patch_prober.go:28] interesting pod/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 12:27:51.802543 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:51.802389    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 12:27:52.421337 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:52.421286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:52.494195 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:52.494162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:52.580950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:52.580913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:52.684652 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:52.684538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:27:52.952707 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:52.952600    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:52.953364 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:52.953339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:27:52.954190 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:27:52.954169    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:28:01.318225 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:01.318185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:28:08.332581 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:08.332531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:08.624532 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:08.624432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:13.704969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:13.704924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:13.804686 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:13.804656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:14.813126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:14.813087    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:14.879866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:14.879829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:14.956022 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:14.955986    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:15.036175 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:15.036142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:15.110934 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:15.110824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:15.932685 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:15.932646    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:28:25.706009 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:25.705971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:26.101997 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:26.101959    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:26.576971 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:26.576942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:32.723631 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:32.723586    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:32.824479 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:32.824445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:32.927078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:32.927042    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:33.024770 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:33.024667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:33.744514 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:33.744468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:33.842043 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:33.842004    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:33.941080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:33.941047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:34.320896 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:34.320865    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:28:35.608438 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:35.608400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:36.177574 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:36.177539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:41.676787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:41.676747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:41.746827 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:41.746783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:42.406619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:42.406574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:48.801509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:48.801460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:48.872820 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:48.872778    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:49.017888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.017850    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:49.336809 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.336772    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"]
Sep 09 12:28:49.340323 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.340283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.342771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.342747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a5f6d9c8-openshift-default-dockercfg-ftfmd\""
Sep 09 12:28:49.354631 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.354602    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"]
Sep 09 12:28:49.367507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.367468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:49.451868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.451825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-podinfo\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.452161 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.452133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-socket\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.452387 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.452357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-data\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.452514 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.452428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-token\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.452583 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.452515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istiod-ca-cert\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.452583 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.452551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jglf8\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-kube-api-access-jglf8\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.452690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.452602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-certs\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.452690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.452650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-credential-socket\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.452793 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.452743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-envoy\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.553773 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.553729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istiod-ca-cert\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.553967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.553783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jglf8\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-kube-api-access-jglf8\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.553967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.553816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-certs\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.553967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.553855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-credential-socket\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.553967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.553909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-envoy\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-podinfo\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-socket\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554333 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-certs\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-data\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554492 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554433    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-credential-socket\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554492 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-token\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554586 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-socket\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554651 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istiod-ca-cert\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.554743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.554726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-data\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.556219 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.556202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-envoy\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.556599 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.556580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-podinfo\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.564027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.563998    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jglf8\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-kube-api-access-jglf8\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.564027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.564013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-token\") pod \"e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") " pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.651526 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.651434    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:49.782264 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.782221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:49.994328 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.994272    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"]
Sep 09 12:28:49.995654 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:28:49.995630    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9687a83_1c12_4c67_bd61_f7afea24c6ec.slice/crio-3b52111f5922f830aee2d403b664b314500a62dfbc7061e53b83f333c742a3c0 WatchSource:0}: Error finding container 3b52111f5922f830aee2d403b664b314500a62dfbc7061e53b83f333c742a3c0: Status 404 returned error can't find the container with id 3b52111f5922f830aee2d403b664b314500a62dfbc7061e53b83f333c742a3c0
Sep 09 12:28:49.998013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.997979    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:28:49.998123 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.998063    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:28:49.998123 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:49.998116    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:28:50.143894 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:50.143853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" event={"ID":"d9687a83-1c12-4c67-bd61-f7afea24c6ec","Type":"ContainerStarted","Data":"6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7"}
Sep 09 12:28:50.144086 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:50.143933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" event={"ID":"d9687a83-1c12-4c67-bd61-f7afea24c6ec","Type":"ContainerStarted","Data":"3b52111f5922f830aee2d403b664b314500a62dfbc7061e53b83f333c742a3c0"}
Sep 09 12:28:50.167131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:50.167076    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" podStartSLOduration=1.16706052 podStartE2EDuration="1.16706052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:28:50.163901721 +0000 UTC m=+1046.210026903" watchObservedRunningTime="2026-09-09 12:28:50.16706052 +0000 UTC m=+1046.213185743"
Sep 09 12:28:50.652385 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:50.652352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:51.657950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:51.657922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:52.156594 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:52.156564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:52.157701 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:52.157678    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:28:55.547359 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:55.547263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:55.648967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:55.648928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:56.666510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.666468    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"]
Sep 09 12:28:56.670052 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.670023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.672828 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.672797    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a5f6d9c8-serving-cert\""
Sep 09 12:28:56.680953 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.680828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"]
Sep 09 12:28:56.717645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.717606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:56.727892 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.727853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-metrics-certs\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.728065 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.727958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5377190-75aa-4dd3-8dad-212aa3fb5737-openshift-service-ca\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.728065 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.728010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.728065 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.728059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7c9s\" (UniqueName: \"kubernetes.io/projected/e5377190-75aa-4dd3-8dad-212aa3fb5737-kube-api-access-r7c9s\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.814872 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.814832    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:56.829613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.829574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7c9s\" (UniqueName: \"kubernetes.io/projected/e5377190-75aa-4dd3-8dad-212aa3fb5737-kube-api-access-r7c9s\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.829784 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.829663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-metrics-certs\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.829784 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.829730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5377190-75aa-4dd3-8dad-212aa3fb5737-openshift-service-ca\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.829784 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.829761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.829911 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:28:56.829864    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-serving-cert: secret "maas-api-e2e-mt-a5f6d9c8-serving-cert" not found
Sep 09 12:28:56.829947 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:28:56.829925    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls podName:e5377190-75aa-4dd3-8dad-212aa3fb5737 nodeName:}" failed. No retries permitted until 2026-09-09 12:28:57.329909109 +0000 UTC m=+1053.376034266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls") pod "maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk" (UID: "e5377190-75aa-4dd3-8dad-212aa3fb5737") : secret "maas-api-e2e-mt-a5f6d9c8-serving-cert" not found
Sep 09 12:28:56.830510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.830487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5377190-75aa-4dd3-8dad-212aa3fb5737-openshift-service-ca\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.832256 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.832233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-metrics-certs\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.839479 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.839449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7c9s\" (UniqueName: \"kubernetes.io/projected/e5377190-75aa-4dd3-8dad-212aa3fb5737-kube-api-access-r7c9s\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:56.918109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:56.918015    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:57.217633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:57.217540    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:57.314438 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:57.314400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:28:57.335128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:57.335090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:57.338106 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:57.338073    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls\") pod \"maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:57.585872 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:57.585842    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:57.860780 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:57.860745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"]
Sep 09 12:28:57.862053 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:28:57.862015    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5377190_75aa_4dd3_8dad_212aa3fb5737.slice/crio-0434ab5317618c26148c1d3e740aa5fb2fe1ba2886b07acd6b8f176a6a584533 WatchSource:0}: Error finding container 0434ab5317618c26148c1d3e740aa5fb2fe1ba2886b07acd6b8f176a6a584533: Status 404 returned error can't find the container with id 0434ab5317618c26148c1d3e740aa5fb2fe1ba2886b07acd6b8f176a6a584533
Sep 09 12:28:58.194561 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:58.194472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk" event={"ID":"e5377190-75aa-4dd3-8dad-212aa3fb5737","Type":"ContainerStarted","Data":"0434ab5317618c26148c1d3e740aa5fb2fe1ba2886b07acd6b8f176a6a584533"}
Sep 09 12:28:58.814150 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:58.814050    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:28:59.204541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:59.204441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk" event={"ID":"e5377190-75aa-4dd3-8dad-212aa3fb5737","Type":"ContainerStarted","Data":"2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6"}
Sep 09 12:28:59.204541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:59.204528    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:28:59.223797 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:28:59.223744    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk" podStartSLOduration=2.524468093 podStartE2EDuration="3.223726792s" totalImagesPullingTime="699.258699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:28:59.221728528 +0000 UTC m=+1055.267853708" watchObservedRunningTime="2026-09-09 12:28:59.223726792 +0000 UTC m=+1055.269851969"
Sep 09 12:29:01.183819 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:01.183764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:05.216814 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:05.216785    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:29:06.148836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:06.148802    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:06.248706 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:06.248674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:16.212062 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.212026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:16.444203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.444104    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"]
Sep 09 12:29:16.444432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.444380    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82" podUID="eacb694b-dfee-4d85-a037-20a71962ceee" containerName="maas-api" containerID="cri-o://87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c" gracePeriod=30
Sep 09 12:29:16.471356 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.471284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:16.543322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.543211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:16.644087 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.644033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:16.708749 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.708711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:16.729816 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.729789    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:29:16.741732 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.741696    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eacb694b-dfee-4d85-a037-20a71962ceee-openshift-service-ca\") pod \"eacb694b-dfee-4d85-a037-20a71962ceee\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") "
Sep 09 12:29:16.741909 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.741761    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45rd4\" (UniqueName: \"kubernetes.io/projected/eacb694b-dfee-4d85-a037-20a71962ceee-kube-api-access-45rd4\") pod \"eacb694b-dfee-4d85-a037-20a71962ceee\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") "
Sep 09 12:29:16.741909 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.741796    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-metrics-certs\") pod \"eacb694b-dfee-4d85-a037-20a71962ceee\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") "
Sep 09 12:29:16.742051 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.741943    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls\") pod \"eacb694b-dfee-4d85-a037-20a71962ceee\" (UID: \"eacb694b-dfee-4d85-a037-20a71962ceee\") "
Sep 09 12:29:16.742138 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.742109    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eacb694b-dfee-4d85-a037-20a71962ceee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eacb694b-dfee-4d85-a037-20a71962ceee" (UID: "eacb694b-dfee-4d85-a037-20a71962ceee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:29:16.742221 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.742207    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eacb694b-dfee-4d85-a037-20a71962ceee-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:16.744507 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.744478    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eacb694b-dfee-4d85-a037-20a71962ceee-kube-api-access-45rd4" (OuterVolumeSpecName: "kube-api-access-45rd4") pod "eacb694b-dfee-4d85-a037-20a71962ceee" (UID: "eacb694b-dfee-4d85-a037-20a71962ceee"). InnerVolumeSpecName "kube-api-access-45rd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:29:16.744633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.744579    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eacb694b-dfee-4d85-a037-20a71962ceee" (UID: "eacb694b-dfee-4d85-a037-20a71962ceee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:29:16.744684 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.744623    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eacb694b-dfee-4d85-a037-20a71962ceee" (UID: "eacb694b-dfee-4d85-a037-20a71962ceee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:29:16.843082 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.842992    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:16.843082 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.843038    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45rd4\" (UniqueName: \"kubernetes.io/projected/eacb694b-dfee-4d85-a037-20a71962ceee-kube-api-access-45rd4\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:16.843082 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:16.843056    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eacb694b-dfee-4d85-a037-20a71962ceee-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:17.091958 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.091920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:17.319315 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.319250    2560 generic.go:356] "Generic (PLEG): container finished" podID="eacb694b-dfee-4d85-a037-20a71962ceee" containerID="87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c" exitCode=0
Sep 09 12:29:17.319315 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.319286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82" event={"ID":"eacb694b-dfee-4d85-a037-20a71962ceee","Type":"ContainerDied","Data":"87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c"}
Sep 09 12:29:17.319872 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.319334    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"
Sep 09 12:29:17.319872 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.319402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82" event={"ID":"eacb694b-dfee-4d85-a037-20a71962ceee","Type":"ContainerDied","Data":"5fdcf12e54a403d50cc577a4f5dee8cdb824010bf6bcd41893e18257169b75b2"}
Sep 09 12:29:17.319872 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.319419    2560 scope.go:117] "RemoveContainer" containerID="87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c"
Sep 09 12:29:17.330611 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.330589    2560 scope.go:117] "RemoveContainer" containerID="87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c"
Sep 09 12:29:17.330928 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:29:17.330905    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c\": container with ID starting with 87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c not found: ID does not exist" containerID="87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c"
Sep 09 12:29:17.330992 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.330939    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c"} err="failed to get container status \"87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c\": rpc error: code = NotFound desc = could not find container \"87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c\": container with ID starting with 87bca39e80507a2596bf7351c174b94e936f88191bb49652f8bb0ed962a8c62c not found: ID does not exist"
Sep 09 12:29:17.345905 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.345812    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"]
Sep 09 12:29:17.352113 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:17.352083    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-b402ba-865f7b544f-4wx82"]
Sep 09 12:29:18.400523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:18.400483    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eacb694b-dfee-4d85-a037-20a71962ceee" path="/var/lib/kubelet/pods/eacb694b-dfee-4d85-a037-20a71962ceee/volumes"
Sep 09 12:29:18.733252 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:18.733131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:20.344141 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:20.344109    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerID="6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7" exitCode=0
Sep 09 12:29:20.344612 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:20.344166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" event={"ID":"d9687a83-1c12-4c67-bd61-f7afea24c6ec","Type":"ContainerDied","Data":"6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7"}
Sep 09 12:29:20.344659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:20.344647    2560 scope.go:117] "RemoveContainer" containerID="6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7"
Sep 09 12:29:20.345823 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:20.345792    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:29:20.345916 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:20.345859    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:29:20.345916 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:20.345893    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:29:20.608130 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:20.608034    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:21.323150 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:21.323107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:21.357956 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:21.357917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" event={"ID":"d9687a83-1c12-4c67-bd61-f7afea24c6ec","Type":"ContainerStarted","Data":"8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637"}
Sep 09 12:29:21.422556 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:21.422522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:21.652136 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:21.652028    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:29:21.653641 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:21.653601    2560 patch_prober.go:28] interesting pod/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 09 12:29:21.653808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:21.653679    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 09 12:29:21.819831 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:21.819795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:21.961378 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:21.961023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:22.156539 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:22.156496    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:29:22.652181 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:22.652128    2560 patch_prober.go:28] interesting pod/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 09 12:29:22.652704 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:22.652225    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 09 12:29:23.652738 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:23.652693    2560 patch_prober.go:28] interesting pod/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 09 12:29:23.653241 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:23.652784    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 09 12:29:23.700042 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:23.700007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:23.800824 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:23.800789    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:23.961948 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:23.958913    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"]
Sep 09 12:29:23.961948 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:23.959206    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy" containerID="cri-o://dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd" gracePeriod=30
Sep 09 12:29:23.973486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:23.973354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:24.447440 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:24.447334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:24.664456 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:24.664414    2560 patch_prober.go:28] interesting pod/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 09 12:29:24.664952 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:24.664479    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 09 12:29:24.770745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:24.770652    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:25.215700 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:25.215671    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:25.317188 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:25.317137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:29:25.652333 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:25.652275    2560 patch_prober.go:28] interesting pod/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 09 12:29:25.652659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:25.652626    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 09 12:29:25.785473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:25.785406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:25.875579 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:25.875546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:26.002284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:26.002188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:26.652643 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:26.652605    2560 patch_prober.go:28] interesting pod/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 09 12:29:26.652962 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:26.652929    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 09 12:29:27.656681 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:27.656648    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:29:27.657935 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:27.657913    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:29:28.198140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:28.198099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:28.319040 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:28.318997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:29.237568 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.237489    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:29:29.288402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288365    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-envoy\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.288588 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288426    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-podinfo\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.288588 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288482    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-data\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.288588 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288520    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-certs\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.288588 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-token\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.288802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288596    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-credential-socket\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.288802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288639    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istiod-ca-cert\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.288802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288669    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-socket\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.288802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qfh8\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-kube-api-access-2qfh8\") pod \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\" (UID: \"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1\") "
Sep 09 12:29:29.289018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.288828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:29.289161 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.289078    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:29.289161 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.289111    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.289161 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.289141    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:29:29.289452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.289280    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-data" (OuterVolumeSpecName: "istio-data") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:29.289452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.289330    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:29.290883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.290846    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:29.291308 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.291272    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:29:29.291436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.291391    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-token" (OuterVolumeSpecName: "istio-token") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:29:29.291640 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.291614    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-kube-api-access-2qfh8" (OuterVolumeSpecName: "kube-api-access-2qfh8") pod "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" (UID: "2abcd47c-289a-48cc-ad0a-d4a3adf33fc1"). InnerVolumeSpecName "kube-api-access-2qfh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:29:29.389812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.389773    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.389812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.389805    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.389812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.389813    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.389812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.389821    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.390094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.389828    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.390094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.389837    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.390094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.389844    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.390094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.389852    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qfh8\" (UniqueName: \"kubernetes.io/projected/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1-kube-api-access-2qfh8\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:29.409189 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.409139    2560 generic.go:356] "Generic (PLEG): container finished" podID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerID="dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd" exitCode=0
Sep 09 12:29:29.409389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.409198    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"
Sep 09 12:29:29.409389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.409224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" event={"ID":"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1","Type":"ContainerDied","Data":"dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd"}
Sep 09 12:29:29.409389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.409304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg" event={"ID":"2abcd47c-289a-48cc-ad0a-d4a3adf33fc1","Type":"ContainerDied","Data":"5c943293bd25c99bb9c692007e61726245b94a52288c321da598a751d78df318"}
Sep 09 12:29:29.409389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.409328    2560 scope.go:117] "RemoveContainer" containerID="dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd"
Sep 09 12:29:29.419686 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.419664    2560 scope.go:117] "RemoveContainer" containerID="6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674"
Sep 09 12:29:29.431045 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.431015    2560 scope.go:117] "RemoveContainer" containerID="dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd"
Sep 09 12:29:29.431427 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:29:29.431405    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd\": container with ID starting with dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd not found: ID does not exist" containerID="dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd"
Sep 09 12:29:29.431513 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.431434    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd"} err="failed to get container status \"dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd\": rpc error: code = NotFound desc = could not find container \"dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd\": container with ID starting with dab7d60ebefd1ceb95dc698a0dea9b7f706a895473842f9d678b6f29ba0c23dd not found: ID does not exist"
Sep 09 12:29:29.431513 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.431453    2560 scope.go:117] "RemoveContainer" containerID="6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674"
Sep 09 12:29:29.431710 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:29:29.431695    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674\": container with ID starting with 6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674 not found: ID does not exist" containerID="6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674"
Sep 09 12:29:29.431749 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.431713    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674"} err="failed to get container status \"6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674\": rpc error: code = NotFound desc = could not find container \"6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674\": container with ID starting with 6f5793b37d63df959ab7aa8763f32d62254ddae5c2d676815eb8f4b259cc9674 not found: ID does not exist"
Sep 09 12:29:29.433815 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.433788    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"]
Sep 09 12:29:29.436749 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:29.436721    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-b402ba-openshift-default-f98698564-wv4kg"]
Sep 09 12:29:30.400157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:30.400121    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" path="/var/lib/kubelet/pods/2abcd47c-289a-48cc-ad0a-d4a3adf33fc1/volumes"
Sep 09 12:29:39.163332 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.163281    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"]
Sep 09 12:29:39.163831 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.163555    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk" podUID="e5377190-75aa-4dd3-8dad-212aa3fb5737" containerName="maas-api" containerID="cri-o://2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6" gracePeriod=30
Sep 09 12:29:39.191569 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.191529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:39.259677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.259645    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:39.327634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.327592    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:39.403452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.403417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:39.437095 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.437062    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:29:39.474272 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.474232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:39.479267 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.479227    2560 generic.go:356] "Generic (PLEG): container finished" podID="e5377190-75aa-4dd3-8dad-212aa3fb5737" containerID="2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6" exitCode=0
Sep 09 12:29:39.479474 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.479393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk" event={"ID":"e5377190-75aa-4dd3-8dad-212aa3fb5737","Type":"ContainerDied","Data":"2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6"}
Sep 09 12:29:39.479474 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.479427    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"
Sep 09 12:29:39.479474 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.479448    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk" event={"ID":"e5377190-75aa-4dd3-8dad-212aa3fb5737","Type":"ContainerDied","Data":"0434ab5317618c26148c1d3e740aa5fb2fe1ba2886b07acd6b8f176a6a584533"}
Sep 09 12:29:39.479689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.479478    2560 scope.go:117] "RemoveContainer" containerID="2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6"
Sep 09 12:29:39.493859 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.492834    2560 scope.go:117] "RemoveContainer" containerID="2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6"
Sep 09 12:29:39.498194 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:29:39.498066    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6\": container with ID starting with 2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6 not found: ID does not exist" containerID="2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6"
Sep 09 12:29:39.498194 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.498113    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6"} err="failed to get container status \"2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6\": rpc error: code = NotFound desc = could not find container \"2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6\": container with ID starting with 2a0d5b1a2bd0d8bd929c9986700ec3f2308552c256dfb2ea3874b56c26f491b6 not found: ID does not exist"
Sep 09 12:29:39.601106 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.601075    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5377190-75aa-4dd3-8dad-212aa3fb5737-openshift-service-ca\") pod \"e5377190-75aa-4dd3-8dad-212aa3fb5737\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") "
Sep 09 12:29:39.601361 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.601137    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7c9s\" (UniqueName: \"kubernetes.io/projected/e5377190-75aa-4dd3-8dad-212aa3fb5737-kube-api-access-r7c9s\") pod \"e5377190-75aa-4dd3-8dad-212aa3fb5737\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") "
Sep 09 12:29:39.601361 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.601192    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls\") pod \"e5377190-75aa-4dd3-8dad-212aa3fb5737\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") "
Sep 09 12:29:39.601361 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.601322    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-metrics-certs\") pod \"e5377190-75aa-4dd3-8dad-212aa3fb5737\" (UID: \"e5377190-75aa-4dd3-8dad-212aa3fb5737\") "
Sep 09 12:29:39.601597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.601569    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5377190-75aa-4dd3-8dad-212aa3fb5737-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e5377190-75aa-4dd3-8dad-212aa3fb5737" (UID: "e5377190-75aa-4dd3-8dad-212aa3fb5737"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:29:39.601722 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.601707    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5377190-75aa-4dd3-8dad-212aa3fb5737-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:39.603387 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.603354    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e5377190-75aa-4dd3-8dad-212aa3fb5737" (UID: "e5377190-75aa-4dd3-8dad-212aa3fb5737"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:29:39.603799 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.603775    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e5377190-75aa-4dd3-8dad-212aa3fb5737" (UID: "e5377190-75aa-4dd3-8dad-212aa3fb5737"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:29:39.603884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.603818    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5377190-75aa-4dd3-8dad-212aa3fb5737-kube-api-access-r7c9s" (OuterVolumeSpecName: "kube-api-access-r7c9s") pod "e5377190-75aa-4dd3-8dad-212aa3fb5737" (UID: "e5377190-75aa-4dd3-8dad-212aa3fb5737"). InnerVolumeSpecName "kube-api-access-r7c9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:29:39.703031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.702930    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:39.703031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.702966    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5377190-75aa-4dd3-8dad-212aa3fb5737-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:39.703031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.702976    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7c9s\" (UniqueName: \"kubernetes.io/projected/e5377190-75aa-4dd3-8dad-212aa3fb5737-kube-api-access-r7c9s\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:39.771738 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.771701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:39.804376 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.804343    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"]
Sep 09 12:29:39.808736 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:39.808701    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5f6d9c8-9998fdbfc-h2dwk"]
Sep 09 12:29:40.404316 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:40.404251    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5377190-75aa-4dd3-8dad-212aa3fb5737" path="/var/lib/kubelet/pods/e5377190-75aa-4dd3-8dad-212aa3fb5737/volumes"
Sep 09 12:29:45.814990 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:45.814948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:45.918815 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:45.918763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:46.012679 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:46.012640    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:29:46.060839 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:46.060800    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"]
Sep 09 12:29:46.061109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:46.061073    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy" containerID="cri-o://8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637" gracePeriod=30
Sep 09 12:29:46.080691 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:46.080614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:46.431113 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:46.430997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:46.530836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:46.530800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:46.689782 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:46.689678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:51.329078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.329011    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:29:51.423239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423181    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-data\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.423239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423235    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-envoy\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.423524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423373    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-certs\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.423524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423416    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-podinfo\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.423524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423442    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-credential-socket\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.423524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423503    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istiod-ca-cert\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.423739 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:51.423739 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423645    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jglf8\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-kube-api-access-jglf8\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.423739 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423684    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-socket\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.423739 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423701    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:51.423739 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-token\") pod \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\" (UID: \"d9687a83-1c12-4c67-bd61-f7afea24c6ec\") "
Sep 09 12:29:51.424018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423731    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:51.424018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423866    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:29:51.424018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.423890    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:51.424183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.424128    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.424183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.424147    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.424183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.424157    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.424183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.424165    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.424183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.424178    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.425745 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.425710    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:29:51.425859 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.425765    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-kube-api-access-jglf8" (OuterVolumeSpecName: "kube-api-access-jglf8") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "kube-api-access-jglf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:29:51.425927 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.425907    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:29:51.426025 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.426005    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "d9687a83-1c12-4c67-bd61-f7afea24c6ec" (UID: "d9687a83-1c12-4c67-bd61-f7afea24c6ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:29:51.525518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.525457    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.525518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.525510    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jglf8\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-kube-api-access-jglf8\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.525518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.525523    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.525518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.525532    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9687a83-1c12-4c67-bd61-f7afea24c6ec-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:29:51.554230 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.554198    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerID="8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637" exitCode=0
Sep 09 12:29:51.554414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.554247    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"
Sep 09 12:29:51.554414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.554253    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" event={"ID":"d9687a83-1c12-4c67-bd61-f7afea24c6ec","Type":"ContainerDied","Data":"8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637"}
Sep 09 12:29:51.554414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.554321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb" event={"ID":"d9687a83-1c12-4c67-bd61-f7afea24c6ec","Type":"ContainerDied","Data":"3b52111f5922f830aee2d403b664b314500a62dfbc7061e53b83f333c742a3c0"}
Sep 09 12:29:51.554414 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.554347    2560 scope.go:117] "RemoveContainer" containerID="8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637"
Sep 09 12:29:51.565142 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.565123    2560 scope.go:117] "RemoveContainer" containerID="6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7"
Sep 09 12:29:51.573731 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.573710    2560 scope.go:117] "RemoveContainer" containerID="8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637"
Sep 09 12:29:51.574037 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:29:51.574017    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637\": container with ID starting with 8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637 not found: ID does not exist" containerID="8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637"
Sep 09 12:29:51.574084 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.574046    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637"} err="failed to get container status \"8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637\": rpc error: code = NotFound desc = could not find container \"8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637\": container with ID starting with 8f6821796c3a1b40232dd70c53499eff3776ca87e1c0cd832cfa177f8d9d6637 not found: ID does not exist"
Sep 09 12:29:51.574084 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.574064    2560 scope.go:117] "RemoveContainer" containerID="6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7"
Sep 09 12:29:51.574348 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:29:51.574328    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7\": container with ID starting with 6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7 not found: ID does not exist" containerID="6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7"
Sep 09 12:29:51.574393 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.574355    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7"} err="failed to get container status \"6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7\": rpc error: code = NotFound desc = could not find container \"6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7\": container with ID starting with 6e127bb96ee4e5024575f350c54eb893054b32d73f77ac1612c2424afdc3e3d7 not found: ID does not exist"
Sep 09 12:29:51.580247 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.580183    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"]
Sep 09 12:29:51.586097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:51.586070    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a5f6d9c8-openshift-default-8c99f9d8d-5vvfb"]
Sep 09 12:29:52.400626 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:52.400593    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" path="/var/lib/kubelet/pods/d9687a83-1c12-4c67-bd61-f7afea24c6ec/volumes"
Sep 09 12:29:53.060759 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:53.060711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:53.162182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:53.162141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:53.270802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:53.270767    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:53.443042 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:53.442948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:55.185918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:55.185870    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:56.133131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:56.133094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:58.005499 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:58.005453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:59.640884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:59.640848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:29:59.739942 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:29:59.739905    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:00.609516 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.609477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:00.937846 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.937768    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"]
Sep 09 12:30:00.938236 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938223    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy"
Sep 09 12:30:00.938282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938237    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy"
Sep 09 12:30:00.938282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938250    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eacb694b-dfee-4d85-a037-20a71962ceee" containerName="maas-api"
Sep 09 12:30:00.938282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938256    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eacb694b-dfee-4d85-a037-20a71962ceee" containerName="maas-api"
Sep 09 12:30:00.938282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938270    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy"
Sep 09 12:30:00.938282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938275    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy"
Sep 09 12:30:00.938282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938281    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5377190-75aa-4dd3-8dad-212aa3fb5737" containerName="maas-api"
Sep 09 12:30:00.938482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938286    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5377190-75aa-4dd3-8dad-212aa3fb5737" containerName="maas-api"
Sep 09 12:30:00.938482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938319    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy"
Sep 09 12:30:00.938482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938325    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy"
Sep 09 12:30:00.938482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938384    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5377190-75aa-4dd3-8dad-212aa3fb5737" containerName="maas-api"
Sep 09 12:30:00.938482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938403    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy"
Sep 09 12:30:00.938482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938411    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abcd47c-289a-48cc-ad0a-d4a3adf33fc1" containerName="istio-proxy"
Sep 09 12:30:00.938482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938416    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy"
Sep 09 12:30:00.938482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.938422    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eacb694b-dfee-4d85-a037-20a71962ceee" containerName="maas-api"
Sep 09 12:30:00.941527 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.941506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:00.943902 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.943878    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-d1f639-openshift-default-dockercfg-72bcr\""
Sep 09 12:30:00.954076 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.954050    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"]
Sep 09 12:30:00.961034 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:00.960995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:01.024096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.023958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-envoy\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.024096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.024042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-podinfo\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.024412 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.024105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4m8s\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-kube-api-access-d4m8s\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.024412 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.024135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4af30259-4d85-4d75-9df1-248f4a1aee7d-istiod-ca-cert\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.024412 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.024225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-token\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.024412 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.024363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-data\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.024623 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.024421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-certs\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.024623 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.024465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-socket\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.024623 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.024518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-credential-socket\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125162 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-socket\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-credential-socket\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-envoy\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-podinfo\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4m8s\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-kube-api-access-d4m8s\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4af30259-4d85-4d75-9df1-248f4a1aee7d-istiod-ca-cert\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-token\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125708 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-data\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125772 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-socket\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.125914 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-credential-socket\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.126095 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-data\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.126095 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.125921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-certs\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.126256 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.126113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4af30259-4d85-4d75-9df1-248f4a1aee7d-istiod-ca-cert\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.126256 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.126042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-certs\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.128227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.128062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-podinfo\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.128381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.128259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-envoy\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.143203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.143171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4m8s\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-kube-api-access-d4m8s\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.144453 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.144428    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-token\") pod \"e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") " pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.209603 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.209515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:01.252960 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.252921    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:01.547744 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.547714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"]
Sep 09 12:30:01.550830 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:30:01.550792    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af30259_4d85_4d75_9df1_248f4a1aee7d.slice/crio-43e4fae3b0872f2ec461cc26caa71547c87e067a61f0c200119c1ab51fd7f162 WatchSource:0}: Error finding container 43e4fae3b0872f2ec461cc26caa71547c87e067a61f0c200119c1ab51fd7f162: Status 404 returned error can't find the container with id 43e4fae3b0872f2ec461cc26caa71547c87e067a61f0c200119c1ab51fd7f162
Sep 09 12:30:01.553744 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.553702    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:01.553819 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.553800    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:01.553862 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.553848    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:01.629549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:01.629518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" event={"ID":"4af30259-4d85-4d75-9df1-248f4a1aee7d","Type":"ContainerStarted","Data":"43e4fae3b0872f2ec461cc26caa71547c87e067a61f0c200119c1ab51fd7f162"}
Sep 09 12:30:02.637032 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:02.636987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" event={"ID":"4af30259-4d85-4d75-9df1-248f4a1aee7d","Type":"ContainerStarted","Data":"9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b"}
Sep 09 12:30:03.253817 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:03.253773    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:03.259358 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:03.259327    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:03.291342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:03.291260    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" podStartSLOduration=3.291241561 podStartE2EDuration="3.291241561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:30:02.659478052 +0000 UTC m=+1118.705603231" watchObservedRunningTime="2026-09-09 12:30:03.291241561 +0000 UTC m=+1119.337366739"
Sep 09 12:30:03.643537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:03.643499    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:03.644594 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:03.644571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:04.624310 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:04.624246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:04.717532 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:04.717494    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:05.800256 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.800210    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"]
Sep 09 12:30:05.800942 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.800921    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy"
Sep 09 12:30:05.800988 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.800947    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy"
Sep 09 12:30:05.801081 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.801069    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9687a83-1c12-4c67-bd61-f7afea24c6ec" containerName="istio-proxy"
Sep 09 12:30:05.804991 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.804972    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:05.807426 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.807407    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-d1f639-serving-cert\""
Sep 09 12:30:05.812461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.812436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"]
Sep 09 12:30:05.839679 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.839643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:05.939089 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.939050    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:05.974705 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.974675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6bvm\" (UniqueName: \"kubernetes.io/projected/e97add39-0d65-43f4-809d-03c21a059870-kube-api-access-p6bvm\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:05.974878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.974725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:05.974878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.974763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97add39-0d65-43f4-809d-03c21a059870-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:05.974878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:05.974806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.045054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.045022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:06.075800 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.075767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6bvm\" (UniqueName: \"kubernetes.io/projected/e97add39-0d65-43f4-809d-03c21a059870-kube-api-access-p6bvm\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.075995 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.075816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.075995 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.075836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97add39-0d65-43f4-809d-03c21a059870-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.075995 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.075875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.076624 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.076601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97add39-0d65-43f4-809d-03c21a059870-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.078426 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.078405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.078510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.078441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.083961 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.083937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6bvm\" (UniqueName: \"kubernetes.io/projected/e97add39-0d65-43f4-809d-03c21a059870-kube-api-access-p6bvm\") pod \"maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.119582 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.119551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:06.358401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.358314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:06.401578 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:30:06.401551    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97add39_0d65_43f4_809d_03c21a059870.slice/crio-657e13dc98b2b0af0ca80b7d29f13b0a61b87c76225efa91bb146661b83581d7 WatchSource:0}: Error finding container 657e13dc98b2b0af0ca80b7d29f13b0a61b87c76225efa91bb146661b83581d7: Status 404 returned error can't find the container with id 657e13dc98b2b0af0ca80b7d29f13b0a61b87c76225efa91bb146661b83581d7
Sep 09 12:30:06.404118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.404099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"]
Sep 09 12:30:06.454864 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.454829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:06.665607 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:06.665492    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4" event={"ID":"e97add39-0d65-43f4-809d-03c21a059870","Type":"ContainerStarted","Data":"657e13dc98b2b0af0ca80b7d29f13b0a61b87c76225efa91bb146661b83581d7"}
Sep 09 12:30:07.673433 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:07.673401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4" event={"ID":"e97add39-0d65-43f4-809d-03c21a059870","Type":"ContainerStarted","Data":"0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516"}
Sep 09 12:30:07.673862 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:07.673510    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:07.691196 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:07.691146    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4" podStartSLOduration=1.889446823 podStartE2EDuration="2.691128738s" totalImagesPullingTime="801.681915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:30:07.689737064 +0000 UTC m=+1123.735862241" watchObservedRunningTime="2026-09-09 12:30:07.691128738 +0000 UTC m=+1123.737253916"
Sep 09 12:30:12.223578 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:12.223536    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:30:13.685047 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:13.685017    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:30:23.779159 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:23.779126    2560 generic.go:356] "Generic (PLEG): container finished" podID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerID="9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b" exitCode=0
Sep 09 12:30:23.779593 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:23.779200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" event={"ID":"4af30259-4d85-4d75-9df1-248f4a1aee7d","Type":"ContainerDied","Data":"9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b"}
Sep 09 12:30:23.779637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:23.779609    2560 scope.go:117] "RemoveContainer" containerID="9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b"
Sep 09 12:30:23.780777 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:23.780750    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:23.780840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:23.780817    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:23.780880 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:23.780847    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:24.283088 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:24.283054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:24.787567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:24.787534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" event={"ID":"4af30259-4d85-4d75-9df1-248f4a1aee7d","Type":"ContainerStarted","Data":"8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd"}
Sep 09 12:30:25.254351 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:25.254309    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:25.254577 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:25.254446    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 09 12:30:25.254577 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:25.254488    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 09 12:30:26.254091 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:26.254049    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 09 12:30:26.254703 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:26.254668    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 09 12:30:26.850114 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:26.850065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:27.253867 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:27.253765    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 09 12:30:27.253867 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:27.253832    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 09 12:30:28.253783 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:28.253744    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 09 12:30:28.254406 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:28.254368    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 09 12:30:29.253677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:29.253634    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 09 12:30:29.253900 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:29.253719    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 09 12:30:29.762973 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:29.762937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:30.087933 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.087894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:30.257991 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.257957    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:30.258434 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.258334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:30.258996 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.258980    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:30:30.419453 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.419382    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"]
Sep 09 12:30:30.424284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.424261    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.426883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.426861    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-4ec60c-openshift-default-dockercfg-2svxr\""
Sep 09 12:30:30.438518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.438495    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"]
Sep 09 12:30:30.455357 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.455327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:30.512020 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.511986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-envoy\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.512203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.512047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-data\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.512203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.512172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-credential-socket\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.512337 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.512207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-podinfo\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.512492 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.512465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istiod-ca-cert\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.512598 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.512576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-socket\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.512730 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.512656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-certs\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.512803 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.512691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlvc\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-kube-api-access-xtlvc\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.512856 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.512820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-token\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614163 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-credential-socket\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614163 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-podinfo\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istiod-ca-cert\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-socket\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-certs\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlvc\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-kube-api-access-xtlvc\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-token\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-envoy\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-data\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614818 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614612    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-credential-socket\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614818 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-socket\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614926 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614901    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istiod-ca-cert\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.614985 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-certs\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.615045 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.614976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-data\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.616718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.616691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-envoy\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.616718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.616712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-podinfo\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.623956 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.623932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-token\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.624145 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.624121    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlvc\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-kube-api-access-xtlvc\") pod \"e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") " pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:30.735759 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:30.735676    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:31.023880 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:31.023856    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"]
Sep 09 12:30:31.025816 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:30:31.025790    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da8c4f2_782d_4ff3_9cfc_e92d10e47930.slice/crio-b78ae7f24e536cd47f1142457c3944b7671746c30db65e76c546e22415a74689 WatchSource:0}: Error finding container b78ae7f24e536cd47f1142457c3944b7671746c30db65e76c546e22415a74689: Status 404 returned error can't find the container with id b78ae7f24e536cd47f1142457c3944b7671746c30db65e76c546e22415a74689
Sep 09 12:30:31.027983 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:31.027953    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:31.028103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:31.028081    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:31.028172 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:31.028135    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:30:31.055344 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:31.055315    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:31.831810 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:31.831774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" event={"ID":"8da8c4f2-782d-4ff3-9cfc-e92d10e47930","Type":"ContainerStarted","Data":"8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0"}
Sep 09 12:30:31.832213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:31.831868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" event={"ID":"8da8c4f2-782d-4ff3-9cfc-e92d10e47930","Type":"ContainerStarted","Data":"b78ae7f24e536cd47f1142457c3944b7671746c30db65e76c546e22415a74689"}
Sep 09 12:30:31.860113 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:31.860063    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podStartSLOduration=1.8600496739999999 podStartE2EDuration="1.860049674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:30:31.857245181 +0000 UTC m=+1147.903370360" watchObservedRunningTime="2026-09-09 12:30:31.860049674 +0000 UTC m=+1147.906174852"
Sep 09 12:30:32.736255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:32.736220    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:32.742348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:32.742320    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:32.838444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:32.838414    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:32.839371 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:32.839348    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:30:33.869509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:33.869466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:33.961081 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:33.961045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:35.030122 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.030089    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"]
Sep 09 12:30:35.035098 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.035072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.037453 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.037426    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-4ec60c-serving-cert\""
Sep 09 12:30:35.049111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.049086    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"]
Sep 09 12:30:35.071313 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.071257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:35.164137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.164105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.164347 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.164220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.164347 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.164331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fq2m\" (UniqueName: \"kubernetes.io/projected/c985635f-6a90-425e-80f8-6397c875f7a0-kube-api-access-9fq2m\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.164457 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.164371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c985635f-6a90-425e-80f8-6397c875f7a0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.170032 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.170003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:35.265386 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.265351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.265571 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.265441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.265571 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.265508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fq2m\" (UniqueName: \"kubernetes.io/projected/c985635f-6a90-425e-80f8-6397c875f7a0-kube-api-access-9fq2m\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.265689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.265630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c985635f-6a90-425e-80f8-6397c875f7a0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.266247 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.266224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c985635f-6a90-425e-80f8-6397c875f7a0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.267785 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.267763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.267885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.267822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.270963 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.270939    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:35.274839 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.274820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fq2m\" (UniqueName: \"kubernetes.io/projected/c985635f-6a90-425e-80f8-6397c875f7a0-kube-api-access-9fq2m\") pod \"maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.348896 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.348866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:35.630167 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.630142    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"]
Sep 09 12:30:35.631395 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:30:35.631364    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc985635f_6a90_425e_80f8_6397c875f7a0.slice/crio-f56266f033a328fdf3fc9734c9be10d7cac44f1c4b625d8cceaada128b6492c3 WatchSource:0}: Error finding container f56266f033a328fdf3fc9734c9be10d7cac44f1c4b625d8cceaada128b6492c3: Status 404 returned error can't find the container with id f56266f033a328fdf3fc9734c9be10d7cac44f1c4b625d8cceaada128b6492c3
Sep 09 12:30:35.741693 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.741650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:35.835938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.835901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:35.860817 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:35.860775    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh" event={"ID":"c985635f-6a90-425e-80f8-6397c875f7a0","Type":"ContainerStarted","Data":"f56266f033a328fdf3fc9734c9be10d7cac44f1c4b625d8cceaada128b6492c3"}
Sep 09 12:30:36.868451 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:36.868419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh" event={"ID":"c985635f-6a90-425e-80f8-6397c875f7a0","Type":"ContainerStarted","Data":"330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7"}
Sep 09 12:30:36.868838 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:36.868559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:36.889501 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:36.889436    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh" podStartSLOduration=1.389272469 podStartE2EDuration="1.889415543s" totalImagesPullingTime="500.143074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:30:36.887698684 +0000 UTC m=+1152.933823864" watchObservedRunningTime="2026-09-09 12:30:36.889415543 +0000 UTC m=+1152.935540722"
Sep 09 12:30:38.518345 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:38.518312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:30:41.404488 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:41.404424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:42.880128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:42.880097    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:30:44.464105 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:44.464067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:44.566949 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:44.566914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:45.891980 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:45.891948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:51.534412 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:51.534319    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:55.121765 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:55.121721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:56.721935 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:56.721903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:57.629339 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.629306    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"]
Sep 09 12:30:57.629577 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.629532    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn" podUID="b82152e6-acad-46bf-87c3-34a1cf9e1a47" containerName="maas-api" containerID="cri-o://12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0" gracePeriod=30
Sep 09 12:30:57.674779 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.674686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:57.804867 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.804803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:57.881869 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.881680    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:57.988054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.987751    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:30:57.994391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.993143    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:57.998429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.997517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qbnb\" (UniqueName: \"kubernetes.io/projected/b82152e6-acad-46bf-87c3-34a1cf9e1a47-kube-api-access-2qbnb\") pod \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") "
Sep 09 12:30:57.998429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.997644    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82152e6-acad-46bf-87c3-34a1cf9e1a47-openshift-service-ca\") pod \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") "
Sep 09 12:30:57.998429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.997672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-metrics-certs\") pod \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") "
Sep 09 12:30:57.998429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.997823    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-maas-api-tls\") pod \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\" (UID: \"b82152e6-acad-46bf-87c3-34a1cf9e1a47\") "
Sep 09 12:30:57.998429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:57.998200    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82152e6-acad-46bf-87c3-34a1cf9e1a47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b82152e6-acad-46bf-87c3-34a1cf9e1a47" (UID: "b82152e6-acad-46bf-87c3-34a1cf9e1a47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:30:58.006348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.006124    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82152e6-acad-46bf-87c3-34a1cf9e1a47-kube-api-access-2qbnb" (OuterVolumeSpecName: "kube-api-access-2qbnb") pod "b82152e6-acad-46bf-87c3-34a1cf9e1a47" (UID: "b82152e6-acad-46bf-87c3-34a1cf9e1a47"). InnerVolumeSpecName "kube-api-access-2qbnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:30:58.009541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.008807    2560 generic.go:356] "Generic (PLEG): container finished" podID="b82152e6-acad-46bf-87c3-34a1cf9e1a47" containerID="12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0" exitCode=0
Sep 09 12:30:58.009541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.008914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn" event={"ID":"b82152e6-acad-46bf-87c3-34a1cf9e1a47","Type":"ContainerDied","Data":"12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0"}
Sep 09 12:30:58.009541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.008973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn" event={"ID":"b82152e6-acad-46bf-87c3-34a1cf9e1a47","Type":"ContainerDied","Data":"d1372aa3eec451bd3856d5ed62955004dbd701668c8cb19cb53689513a381c06"}
Sep 09 12:30:58.009541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.009007    2560 scope.go:117] "RemoveContainer" containerID="12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0"
Sep 09 12:30:58.009541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.009179    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"
Sep 09 12:30:58.010740 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.010685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b82152e6-acad-46bf-87c3-34a1cf9e1a47" (UID: "b82152e6-acad-46bf-87c3-34a1cf9e1a47"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:30:58.011572 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.011006    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b82152e6-acad-46bf-87c3-34a1cf9e1a47" (UID: "b82152e6-acad-46bf-87c3-34a1cf9e1a47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:30:58.032390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.032356    2560 scope.go:117] "RemoveContainer" containerID="12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0"
Sep 09 12:30:58.032759 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:30:58.032728    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0\": container with ID starting with 12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0 not found: ID does not exist" containerID="12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0"
Sep 09 12:30:58.032855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.032770    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0"} err="failed to get container status \"12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0\": rpc error: code = NotFound desc = could not find container \"12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0\": container with ID starting with 12d972a0d3a72a69a810c5090d02543fb3742b451ee574022602d574ee04dba0 not found: ID does not exist"
Sep 09 12:30:58.099897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.099851    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:30:58.099897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.099897    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qbnb\" (UniqueName: \"kubernetes.io/projected/b82152e6-acad-46bf-87c3-34a1cf9e1a47-kube-api-access-2qbnb\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:30:58.100085 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.099912    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82152e6-acad-46bf-87c3-34a1cf9e1a47-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:30:58.100085 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.099926    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b82152e6-acad-46bf-87c3-34a1cf9e1a47-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:30:58.151639 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.150869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:58.341558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.341487    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"]
Sep 09 12:30:58.355603 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.355569    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e49066-7986878897-k2djn"]
Sep 09 12:30:58.401077 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.401047    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82152e6-acad-46bf-87c3-34a1cf9e1a47" path="/var/lib/kubelet/pods/b82152e6-acad-46bf-87c3-34a1cf9e1a47/volumes"
Sep 09 12:30:58.574756 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.574720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:30:58.918136 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:30:58.918048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:03.691727 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:03.691685    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:03.880482 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:03.880436    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 12:31:03.880661 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:03.880512    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 12:31:06.061757 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:06.061726    2560 generic.go:356] "Generic (PLEG): container finished" podID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerID="8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0" exitCode=0
Sep 09 12:31:06.062265 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:06.061802    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" event={"ID":"8da8c4f2-782d-4ff3-9cfc-e92d10e47930","Type":"ContainerDied","Data":"8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0"}
Sep 09 12:31:06.062416 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:06.062398    2560 scope.go:117] "RemoveContainer" containerID="8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0"
Sep 09 12:31:06.063646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:06.063622    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:06.063714 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:06.063684    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:06.063791 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:06.063712    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:07.069944 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:07.069910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" event={"ID":"8da8c4f2-782d-4ff3-9cfc-e92d10e47930","Type":"ContainerStarted","Data":"aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4"}
Sep 09 12:31:07.233560 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:07.233531    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:31:07.736674 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:07.736636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:31:07.737022 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:07.736989    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 09 12:31:07.737244 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:07.737213    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 09 12:31:08.737007 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:08.736970    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 09 12:31:08.737653 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:08.737619    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 09 12:31:09.736239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:09.736205    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 09 12:31:09.736481 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:09.736258    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 09 12:31:10.736587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:10.736541    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 09 12:31:10.737155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:10.737120    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 09 12:31:11.736886 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:11.736839    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 09 12:31:11.737402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:11.736919    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 09 12:31:12.736809 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:12.736772    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 09 12:31:12.737038 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:12.736853    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 09 12:31:13.740578 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:13.740547    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:31:13.741000 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:13.740927    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:31:13.741672 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:13.741653    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:31:14.236069 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.236035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:14.561943 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.561912    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"]
Sep 09 12:31:14.563113 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.563087    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82152e6-acad-46bf-87c3-34a1cf9e1a47" containerName="maas-api"
Sep 09 12:31:14.563113 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.563113    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82152e6-acad-46bf-87c3-34a1cf9e1a47" containerName="maas-api"
Sep 09 12:31:14.563340 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.563254    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82152e6-acad-46bf-87c3-34a1cf9e1a47" containerName="maas-api"
Sep 09 12:31:14.567791 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.567770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.570285 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.570263    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-24ec44a5-openshift-default-dockercfg-wgrfn\""
Sep 09 12:31:14.580357 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.580329    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"]
Sep 09 12:31:14.603423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.603392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:14.692926 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.692894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f53054f8-19e3-4d22-99c3-85e7146de220-istio-podinfo\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.693167 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-credential-socket\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.693340 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng7n\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-kube-api-access-qng7n\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.693340 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-data\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.693340 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-istio-token\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.693562 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-socket\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.693562 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:14.693562 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f53054f8-19e3-4d22-99c3-85e7146de220-istiod-ca-cert\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.693720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-certs\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.693720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.693629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-envoy\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795162 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f53054f8-19e3-4d22-99c3-85e7146de220-istio-podinfo\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-credential-socket\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng7n\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-kube-api-access-qng7n\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-data\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-istio-token\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-socket\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f53054f8-19e3-4d22-99c3-85e7146de220-istiod-ca-cert\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-certs\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.795688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-envoy\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.796128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-credential-socket\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.796128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-socket\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.796128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.795884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-certs\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.796128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.796053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-data\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.796393 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.796369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f53054f8-19e3-4d22-99c3-85e7146de220-istiod-ca-cert\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.797747 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.797720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-envoy\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.797855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.797838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f53054f8-19e3-4d22-99c3-85e7146de220-istio-podinfo\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.806092 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.806068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-istio-token\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.806419 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.806395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng7n\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-kube-api-access-qng7n\") pod \"e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") " pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:14.866801 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.866734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:14.880674 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:14.880652    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:15.038031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:15.037997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:15.178909 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:15.172066    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"]
Sep 09 12:31:15.178909 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:15.177969    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:15.179510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:15.179446    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:15.179613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:15.179551    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:15.179613 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:15.179589    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:16.125271 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:16.125231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" event={"ID":"f53054f8-19e3-4d22-99c3-85e7146de220","Type":"ContainerStarted","Data":"c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6"}
Sep 09 12:31:16.125730 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:16.125285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" event={"ID":"f53054f8-19e3-4d22-99c3-85e7146de220","Type":"ContainerStarted","Data":"e9e7fdaf9649ed26881a253d081127711146d1cfbe2fe7431bda14d8ddd6e6d8"}
Sep 09 12:31:16.151391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:16.151344    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" podStartSLOduration=2.15132801 podStartE2EDuration="2.15132801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:31:16.148396538 +0000 UTC m=+1192.194521914" watchObservedRunningTime="2026-09-09 12:31:16.15132801 +0000 UTC m=+1192.197453198"
Sep 09 12:31:16.881303 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:16.881266    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:16.886503 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:16.886479    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:17.131986 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:17.131909    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:17.132841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:17.132821    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:18.182441 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:18.182405    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:18.278028 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:18.277979    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:19.331705 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.331676    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"]
Sep 09 12:31:19.335632 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.335610    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.338002 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.337985    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-24ec44a5-serving-cert\""
Sep 09 12:31:19.362467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.362431    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"]
Sep 09 12:31:19.402787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.402745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:19.445941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.445907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-metrics-certs\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.446101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.445966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.446101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.446049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g277s\" (UniqueName: \"kubernetes.io/projected/9eb3c817-ae1b-404a-8009-9321d172ae6b-kube-api-access-g277s\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.446101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.446086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb3c817-ae1b-404a-8009-9321d172ae6b-openshift-service-ca\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.507250 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.507211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:19.547437 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.547396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-metrics-certs\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.547622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.547493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.547622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.547545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g277s\" (UniqueName: \"kubernetes.io/projected/9eb3c817-ae1b-404a-8009-9321d172ae6b-kube-api-access-g277s\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.547622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.547597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb3c817-ae1b-404a-8009-9321d172ae6b-openshift-service-ca\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.547792 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:31:19.547621    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-serving-cert: secret "maas-api-e2e-mt-24ec44a5-serving-cert" not found
Sep 09 12:31:19.547792 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:31:19.547696    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls podName:9eb3c817-ae1b-404a-8009-9321d172ae6b nodeName:}" failed. No retries permitted until 2026-09-09 12:31:20.047673616 +0000 UTC m=+1196.093798793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls") pod "maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2" (UID: "9eb3c817-ae1b-404a-8009-9321d172ae6b") : secret "maas-api-e2e-mt-24ec44a5-serving-cert" not found
Sep 09 12:31:19.548249 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.548226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb3c817-ae1b-404a-8009-9321d172ae6b-openshift-service-ca\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.549844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.549827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-metrics-certs\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.562732 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.562703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g277s\" (UniqueName: \"kubernetes.io/projected/9eb3c817-ae1b-404a-8009-9321d172ae6b-kube-api-access-g277s\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:19.850054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:19.850007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:20.053281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:20.053240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:20.055675 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:20.055649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls\") pod \"maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:20.249397 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:20.249315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:20.538025 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:20.537514    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"]
Sep 09 12:31:21.158079 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:21.158039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2" event={"ID":"9eb3c817-ae1b-404a-8009-9321d172ae6b","Type":"ContainerStarted","Data":"8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095"}
Sep 09 12:31:21.158245 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:21.158099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2" event={"ID":"9eb3c817-ae1b-404a-8009-9321d172ae6b","Type":"ContainerStarted","Data":"acbd1901142fab3af23aa9dee293ed331ba7615c1f510707801c8cea78939b30"}
Sep 09 12:31:21.158245 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:21.158126    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:21.185512 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:21.185455    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2" podStartSLOduration=1.698354602 podStartE2EDuration="2.185428886s" totalImagesPullingTime="487.074284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:31:21.18363224 +0000 UTC m=+1197.229757419" watchObservedRunningTime="2026-09-09 12:31:21.185428886 +0000 UTC m=+1197.231554064"
Sep 09 12:31:21.614809 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:21.614755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:21.713767 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:21.713732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:24.423786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:24.423760    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:31:24.435318 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:24.435278    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:31:27.169825 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:27.169796    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:31:29.240901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:29.240865    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:31:38.907689 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:38.907647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:39.271813 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:39.271723    2560 generic.go:356] "Generic (PLEG): container finished" podID="f53054f8-19e3-4d22-99c3-85e7146de220" containerID="c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6" exitCode=0
Sep 09 12:31:39.271813 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:39.271780    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" event={"ID":"f53054f8-19e3-4d22-99c3-85e7146de220","Type":"ContainerDied","Data":"c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6"}
Sep 09 12:31:39.272224 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:39.272204    2560 scope.go:117] "RemoveContainer" containerID="c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6"
Sep 09 12:31:39.273376 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:39.273346    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:39.273484 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:39.273430    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:39.273549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:39.273485    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:31:40.280044 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:40.280007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" event={"ID":"f53054f8-19e3-4d22-99c3-85e7146de220","Type":"ContainerStarted","Data":"5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6"}
Sep 09 12:31:40.881076 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:40.881044    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:40.881418 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:40.881396    2560 patch_prober.go:28] interesting pod/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 09 12:31:40.881488 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:40.881442    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 09 12:31:41.078473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:41.078439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:41.317065 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:41.317035    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"]
Sep 09 12:31:41.317547 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:41.317223    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy" containerID="cri-o://3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35" gracePeriod=30
Sep 09 12:31:41.335334 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:41.333597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:41.881652 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:41.881617    2560 patch_prober.go:28] interesting pod/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 09 12:31:41.881830 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:41.881683    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 09 12:31:42.089220 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:42.089175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:42.463207 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:42.463173    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:42.881239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:42.881204    2560 patch_prober.go:28] interesting pod/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 09 12:31:42.881420 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:42.881258    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 09 12:31:43.150165 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:43.150066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:43.252512 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:43.252469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:43.850696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:43.850658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:43.881409 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:43.881373    2560 patch_prober.go:28] interesting pod/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 09 12:31:43.881566 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:43.881430    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 09 12:31:44.881167 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:44.881128    2560 patch_prober.go:28] interesting pod/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 09 12:31:44.881619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:44.881190    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 09 12:31:45.885690 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:45.885658    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:45.886149 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:45.885943    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:45.886646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:45.886628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:31:46.570754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.570734    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:31:46.645737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645659    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-certs\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.645737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645698    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-data\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.645737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-credential-socket\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.646013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645765    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istiod-ca-cert\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.646013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645797    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-token\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.646013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq4nq\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-kube-api-access-jq4nq\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.646013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645857    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-envoy\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.646013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645904    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-podinfo\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.646013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-socket\") pod \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\" (UID: \"044edf02-2a9b-4bfb-8cc1-67dfb1aad903\") "
Sep 09 12:31:46.646013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.645974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:31:46.646401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.646027    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-data" (OuterVolumeSpecName: "istio-data") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:31:46.646401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.646122    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:31:46.646401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.646215    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:31:46.646401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.646357    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:46.646401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.646376    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:46.646401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.646389    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:46.646401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.646402    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:46.646763 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.646509    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:31:46.648037 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.647997    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-kube-api-access-jq4nq" (OuterVolumeSpecName: "kube-api-access-jq4nq") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "kube-api-access-jq4nq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:31:46.648126 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.648061    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:31:46.648405 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.648382    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-token" (OuterVolumeSpecName: "istio-token") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:31:46.648508 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.648478    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "044edf02-2a9b-4bfb-8cc1-67dfb1aad903" (UID: "044edf02-2a9b-4bfb-8cc1-67dfb1aad903"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:31:46.747229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.747200    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:46.747229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.747226    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:46.747229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.747235    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:46.747440 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.747244    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq4nq\" (UniqueName: \"kubernetes.io/projected/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-kube-api-access-jq4nq\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:46.747440 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:46.747253    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044edf02-2a9b-4bfb-8cc1-67dfb1aad903-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:47.323815 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.323780    2560 generic.go:356] "Generic (PLEG): container finished" podID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerID="3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35" exitCode=0
Sep 09 12:31:47.324227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.323823    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"
Sep 09 12:31:47.324227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.323856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" event={"ID":"044edf02-2a9b-4bfb-8cc1-67dfb1aad903","Type":"ContainerDied","Data":"3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35"}
Sep 09 12:31:47.324227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.323907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf" event={"ID":"044edf02-2a9b-4bfb-8cc1-67dfb1aad903","Type":"ContainerDied","Data":"200a0c137bd60e568f47d8dd80136146ba7af9d6da61cbeaeded8f901cc66489"}
Sep 09 12:31:47.324227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.323936    2560 scope.go:117] "RemoveContainer" containerID="3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35"
Sep 09 12:31:47.334017 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.333999    2560 scope.go:117] "RemoveContainer" containerID="cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50"
Sep 09 12:31:47.342856 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.342839    2560 scope.go:117] "RemoveContainer" containerID="3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35"
Sep 09 12:31:47.343150 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:31:47.343131    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35\": container with ID starting with 3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35 not found: ID does not exist" containerID="3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35"
Sep 09 12:31:47.343193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.343160    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35"} err="failed to get container status \"3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35\": rpc error: code = NotFound desc = could not find container \"3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35\": container with ID starting with 3aab94fc3ca58b872a820c69f71eb85a035ebcc39ce184c341420b15429f2b35 not found: ID does not exist"
Sep 09 12:31:47.343193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.343176    2560 scope.go:117] "RemoveContainer" containerID="cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50"
Sep 09 12:31:47.343424 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:31:47.343409    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50\": container with ID starting with cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50 not found: ID does not exist" containerID="cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50"
Sep 09 12:31:47.343485 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.343427    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50"} err="failed to get container status \"cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50\": rpc error: code = NotFound desc = could not find container \"cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50\": container with ID starting with cbf1212f17c04a9b5e2b32097daca4038e4fbe9c043d254dc1fc4ad6d9acfe50 not found: ID does not exist"
Sep 09 12:31:47.350597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.350577    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"]
Sep 09 12:31:47.360228 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:47.360198    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e49066-openshift-default-6d98b49bb-8pgkf"]
Sep 09 12:31:48.399900 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:48.399867    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" path="/var/lib/kubelet/pods/044edf02-2a9b-4bfb-8cc1-67dfb1aad903/volumes"
Sep 09 12:31:51.848598 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:51.848567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:52.467925 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.467891    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"]
Sep 09 12:31:52.468103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.468080    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd" podUID="9a15ba5e-90a8-4cd2-b836-3f00804722a4" containerName="maas-api" containerID="cri-o://02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94" gracePeriod=30
Sep 09 12:31:52.498611 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.498585    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:52.581639 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.581596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:52.649250 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.645036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:52.727497 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.727439    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:31:52.751643 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.751600    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:52.808117 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.808093    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a15ba5e-90a8-4cd2-b836-3f00804722a4-openshift-service-ca\") pod \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") "
Sep 09 12:31:52.808369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.808203    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55rt5\" (UniqueName: \"kubernetes.io/projected/9a15ba5e-90a8-4cd2-b836-3f00804722a4-kube-api-access-55rt5\") pod \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") "
Sep 09 12:31:52.808369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.808255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls\") pod \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") "
Sep 09 12:31:52.808369 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.808274    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-metrics-certs\") pod \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\" (UID: \"9a15ba5e-90a8-4cd2-b836-3f00804722a4\") "
Sep 09 12:31:52.808565 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.808534    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a15ba5e-90a8-4cd2-b836-3f00804722a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a15ba5e-90a8-4cd2-b836-3f00804722a4" (UID: "9a15ba5e-90a8-4cd2-b836-3f00804722a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:31:52.810248 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.810222    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a15ba5e-90a8-4cd2-b836-3f00804722a4" (UID: "9a15ba5e-90a8-4cd2-b836-3f00804722a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:31:52.810387 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.810271    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a15ba5e-90a8-4cd2-b836-3f00804722a4-kube-api-access-55rt5" (OuterVolumeSpecName: "kube-api-access-55rt5") pod "9a15ba5e-90a8-4cd2-b836-3f00804722a4" (UID: "9a15ba5e-90a8-4cd2-b836-3f00804722a4"). InnerVolumeSpecName "kube-api-access-55rt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:31:52.810387 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.810336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9a15ba5e-90a8-4cd2-b836-3f00804722a4" (UID: "9a15ba5e-90a8-4cd2-b836-3f00804722a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:31:52.816584 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.816466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:52.909946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.909905    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:52.909946 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.909947    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a15ba5e-90a8-4cd2-b836-3f00804722a4-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:52.910407 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.909960    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a15ba5e-90a8-4cd2-b836-3f00804722a4-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:52.910407 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:52.909973    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55rt5\" (UniqueName: \"kubernetes.io/projected/9a15ba5e-90a8-4cd2-b836-3f00804722a4-kube-api-access-55rt5\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:31:53.114777 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.114736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:53.363708 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.363675    2560 generic.go:356] "Generic (PLEG): container finished" podID="9a15ba5e-90a8-4cd2-b836-3f00804722a4" containerID="02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94" exitCode=0
Sep 09 12:31:53.363867 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.363728    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"
Sep 09 12:31:53.363867 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.363760    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd" event={"ID":"9a15ba5e-90a8-4cd2-b836-3f00804722a4","Type":"ContainerDied","Data":"02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94"}
Sep 09 12:31:53.363867 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.363845    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd" event={"ID":"9a15ba5e-90a8-4cd2-b836-3f00804722a4","Type":"ContainerDied","Data":"c4f7c2672d6cf6cbb342302ee331a5f78e8c012bf309aaaea7cb709491e1f258"}
Sep 09 12:31:53.364018 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.363875    2560 scope.go:117] "RemoveContainer" containerID="02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94"
Sep 09 12:31:53.373811 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.373794    2560 scope.go:117] "RemoveContainer" containerID="02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94"
Sep 09 12:31:53.374072 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:31:53.374049    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94\": container with ID starting with 02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94 not found: ID does not exist" containerID="02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94"
Sep 09 12:31:53.374143 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.374078    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94"} err="failed to get container status \"02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94\": rpc error: code = NotFound desc = could not find container \"02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94\": container with ID starting with 02f3687c6f0bca48614577943fecc10058ad97cb7489c0aaaf0b62ea8d37bd94 not found: ID does not exist"
Sep 09 12:31:53.388192 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.388172    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"]
Sep 09 12:31:53.394765 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.394746    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a142a-687d5f68f5-lnngd"]
Sep 09 12:31:53.425577 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:53.425519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:54.400179 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:54.400143    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a15ba5e-90a8-4cd2-b836-3f00804722a4" path="/var/lib/kubelet/pods/9a15ba5e-90a8-4cd2-b836-3f00804722a4/volumes"
Sep 09 12:31:57.668509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:57.668471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:31:58.181017 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:31:58.180983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:00.122152 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:00.122109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:03.613109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:03.613062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:04.483185 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:04.483128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:04.580048 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:04.580019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:05.807647 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.807615    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"]
Sep 09 12:32:05.808073 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808058    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy"
Sep 09 12:32:05.808118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808076    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy"
Sep 09 12:32:05.808118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808087    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy"
Sep 09 12:32:05.808118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808092    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy"
Sep 09 12:32:05.808118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808116    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a15ba5e-90a8-4cd2-b836-3f00804722a4" containerName="maas-api"
Sep 09 12:32:05.808118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808122    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a15ba5e-90a8-4cd2-b836-3f00804722a4" containerName="maas-api"
Sep 09 12:32:05.808536 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808210    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a15ba5e-90a8-4cd2-b836-3f00804722a4" containerName="maas-api"
Sep 09 12:32:05.808536 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808228    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy"
Sep 09 12:32:05.808536 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.808243    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="044edf02-2a9b-4bfb-8cc1-67dfb1aad903" containerName="istio-proxy"
Sep 09 12:32:05.812110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.812088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.814615 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.814590    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-679f45-serving-cert\""
Sep 09 12:32:05.824696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.824672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"]
Sep 09 12:32:05.841972 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.841945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.842128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.842028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.842128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.842065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c19a81b-7181-46c3-951d-1b98913cc332-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.842128 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.842084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49gxv\" (UniqueName: \"kubernetes.io/projected/2c19a81b-7181-46c3-951d-1b98913cc332-kube-api-access-49gxv\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.851942 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.851906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:05.942681 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.942649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.942866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.942695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c19a81b-7181-46c3-951d-1b98913cc332-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.942866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.942714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49gxv\" (UniqueName: \"kubernetes.io/projected/2c19a81b-7181-46c3-951d-1b98913cc332-kube-api-access-49gxv\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.942866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.942764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.942987 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:32:05.942908    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-serving-cert: secret "maas-api-e2e-shared-a-w3-679f45-serving-cert" not found
Sep 09 12:32:05.942987 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:32:05.942967    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls podName:2c19a81b-7181-46c3-951d-1b98913cc332 nodeName:}" failed. No retries permitted until 2026-09-09 12:32:06.442950133 +0000 UTC m=+1242.489075289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls") pod "maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp" (UID: "2c19a81b-7181-46c3-951d-1b98913cc332") : secret "maas-api-e2e-shared-a-w3-679f45-serving-cert" not found
Sep 09 12:32:05.943423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.943403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c19a81b-7181-46c3-951d-1b98913cc332-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.945351 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.945328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:05.951822 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.951780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:05.953585 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:05.953553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49gxv\" (UniqueName: \"kubernetes.io/projected/2c19a81b-7181-46c3-951d-1b98913cc332-kube-api-access-49gxv\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:06.386188 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:06.386157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:06.449016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:06.448971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:06.451467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:06.451447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:06.488512 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:06.488475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:06.723522 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:06.723442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:07.005274 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:07.005247    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"]
Sep 09 12:32:07.005993 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:32:07.005971    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c19a81b_7181_46c3_951d_1b98913cc332.slice/crio-f8cf7105c2bc3ae82ef05624ddefc173546bcb37223025a7c8a4e793194929ba WatchSource:0}: Error finding container f8cf7105c2bc3ae82ef05624ddefc173546bcb37223025a7c8a4e793194929ba: Status 404 returned error can't find the container with id f8cf7105c2bc3ae82ef05624ddefc173546bcb37223025a7c8a4e793194929ba
Sep 09 12:32:07.464711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:07.464679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp" event={"ID":"2c19a81b-7181-46c3-951d-1b98913cc332","Type":"ContainerStarted","Data":"f8cf7105c2bc3ae82ef05624ddefc173546bcb37223025a7c8a4e793194929ba"}
Sep 09 12:32:08.472724 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:08.472686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp" event={"ID":"2c19a81b-7181-46c3-951d-1b98913cc332","Type":"ContainerStarted","Data":"158921a68d5014279eabbdf3dc298901a3b4f7f1b296236a6c86b6415c24a00f"}
Sep 09 12:32:08.473122 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:08.472811    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:08.495806 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:08.495756    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp" podStartSLOduration=3.059433175 podStartE2EDuration="3.495740373s" totalImagesPullingTime="436.307198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:32:08.494688196 +0000 UTC m=+1244.540813375" watchObservedRunningTime="2026-09-09 12:32:08.495740373 +0000 UTC m=+1244.541865551"
Sep 09 12:32:09.129921 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:09.129885    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:32:14.484671 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:14.484638    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:32:14.950836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:14.950798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:26.923067 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:26.923030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:29.560816 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:29.560784    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:29.912360 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:29.912238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:30.311353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:30.311309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:30.548152 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:30.548116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:32.065078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:32.065046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:33.824530 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:33.824490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:33.922436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:33.922385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:34.936736 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:34.936699    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"]
Sep 09 12:32:34.942648 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:34.942623    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:34.945007 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:34.944982    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-cfcdfd-serving-cert\""
Sep 09 12:32:34.952163 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:34.952135    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"]
Sep 09 12:32:34.980799 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:34.980764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:35.050186 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.049340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34fe578-3548-4d72-b0f3-cf3a169dac23-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.050186 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.049450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.050186 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.049610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.050186 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.049690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khs4k\" (UniqueName: \"kubernetes.io/projected/d34fe578-3548-4d72-b0f3-cf3a169dac23-kube-api-access-khs4k\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.081049 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.081011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:35.150538 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.150503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.150743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.150563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khs4k\" (UniqueName: \"kubernetes.io/projected/d34fe578-3548-4d72-b0f3-cf3a169dac23-kube-api-access-khs4k\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.150743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.150591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34fe578-3548-4d72-b0f3-cf3a169dac23-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.150743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.150617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.150743 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:32:35.150712    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-serving-cert: secret "maas-api-e2e-shared-b-w3-cfcdfd-serving-cert" not found
Sep 09 12:32:35.150995 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:32:35.150773    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls podName:d34fe578-3548-4d72-b0f3-cf3a169dac23 nodeName:}" failed. No retries permitted until 2026-09-09 12:32:35.650758632 +0000 UTC m=+1271.696883789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls") pod "maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l" (UID: "d34fe578-3548-4d72-b0f3-cf3a169dac23") : secret "maas-api-e2e-shared-b-w3-cfcdfd-serving-cert" not found
Sep 09 12:32:35.151367 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.151348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34fe578-3548-4d72-b0f3-cf3a169dac23-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.153009 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.152986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.159928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.159904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khs4k\" (UniqueName: \"kubernetes.io/projected/d34fe578-3548-4d72-b0f3-cf3a169dac23-kube-api-access-khs4k\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.268699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.268598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:35.603031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.602994    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:35.655969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.655936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.658312 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.658272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:35.701447 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.701406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:32:35.859098 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:35.855851    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:36.157320 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:36.157278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"]
Sep 09 12:32:36.158248 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:32:36.158215    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34fe578_3548_4d72_b0f3_cf3a169dac23.slice/crio-454e597cbba8962d9e65a8cbfe7a7c6aaebf5aa60b9a6fe95a9e2afd79e0013f WatchSource:0}: Error finding container 454e597cbba8962d9e65a8cbfe7a7c6aaebf5aa60b9a6fe95a9e2afd79e0013f: Status 404 returned error can't find the container with id 454e597cbba8962d9e65a8cbfe7a7c6aaebf5aa60b9a6fe95a9e2afd79e0013f
Sep 09 12:32:36.159777 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:36.159756    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 12:32:36.628230 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:36.628191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:32:36.645276 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:36.645237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l" event={"ID":"d34fe578-3548-4d72-b0f3-cf3a169dac23","Type":"ContainerStarted","Data":"454e597cbba8962d9e65a8cbfe7a7c6aaebf5aa60b9a6fe95a9e2afd79e0013f"}
Sep 09 12:32:37.652250 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:37.652207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l" event={"ID":"d34fe578-3548-4d72-b0f3-cf3a169dac23","Type":"ContainerStarted","Data":"be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28"}
Sep 09 12:32:37.652669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:37.652422    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:37.674028 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:37.673964    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l" podStartSLOduration=2.943853889 podStartE2EDuration="3.673947721s" totalImagesPullingTime="730.093832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:32:37.670593675 +0000 UTC m=+1273.716718858" watchObservedRunningTime="2026-09-09 12:32:37.673947721 +0000 UTC m=+1273.720072898"
Sep 09 12:32:43.664563 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:43.664528    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:32:58.772259 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:32:58.772226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:33:06.137059 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:33:06.137018    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:33:26.832677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:33:26.832638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:33:36.719525 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:33:36.719487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:33:37.004215 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:33:37.004119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:00.885621 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:00.885523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:05.016991 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:05.016951    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:34:15.397110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.397073    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"]
Sep 09 12:34:15.402801 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.402766    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.407122 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.407093    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-679f45\"/\"auth-test-model-679f45-kserve-self-signed-certs\""
Sep 09 12:34:15.409494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.407156    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-679f45\"/\"kube-root-ca.crt\""
Sep 09 12:34:15.409494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.407441    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-679f45\"/\"openshift-service-ca.crt\""
Sep 09 12:34:15.409494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.408083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-679f45\"/\"default-dockercfg-skmbs\""
Sep 09 12:34:15.413424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.413195    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"]
Sep 09 12:34:15.433080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.433047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:15.467339 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.467284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sk46\" (UniqueName: \"kubernetes.io/projected/34bc2342-6818-44a2-840a-c8a49cd4d2cb-kube-api-access-2sk46\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.467492 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.467356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-home\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.467492 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.467393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-model-cache\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.467492 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.467466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tmp-dir\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.467659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.467503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tls-certs\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.467659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.467612    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-dshm\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.568878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.568846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sk46\" (UniqueName: \"kubernetes.io/projected/34bc2342-6818-44a2-840a-c8a49cd4d2cb-kube-api-access-2sk46\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.569081 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.568896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-home\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.569081 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.568933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-model-cache\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.569081 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.569007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tmp-dir\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.569081 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.569051    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tls-certs\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.569326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.569129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-dshm\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.569396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.569364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-home\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.569459 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.569434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-model-cache\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.569459 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.569445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tmp-dir\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.571428 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.571406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-dshm\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.571588 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.571569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tls-certs\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.578749 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.578727    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sk46\" (UniqueName: \"kubernetes.io/projected/34bc2342-6818-44a2-840a-c8a49cd4d2cb-kube-api-access-2sk46\") pod \"auth-test-model-679f45-kserve-7f4fbd646c-dfg6z\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") " pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.716804 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.716728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:15.991390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:15.991361    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"]
Sep 09 12:34:15.992259 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:34:15.992229    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34bc2342_6818_44a2_840a_c8a49cd4d2cb.slice/crio-de7f11329a526c65824fd212f0cb5e7afe1f76a55577319d8b6a2b2d7215d395 WatchSource:0}: Error finding container de7f11329a526c65824fd212f0cb5e7afe1f76a55577319d8b6a2b2d7215d395: Status 404 returned error can't find the container with id de7f11329a526c65824fd212f0cb5e7afe1f76a55577319d8b6a2b2d7215d395
Sep 09 12:34:16.272881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:16.272796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z" event={"ID":"34bc2342-6818-44a2-840a-c8a49cd4d2cb","Type":"ContainerStarted","Data":"767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d"}
Sep 09 12:34:16.272881 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:16.272840    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z" event={"ID":"34bc2342-6818-44a2-840a-c8a49cd4d2cb","Type":"ContainerStarted","Data":"de7f11329a526c65824fd212f0cb5e7afe1f76a55577319d8b6a2b2d7215d395"}
Sep 09 12:34:16.291193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:16.291140    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z" podStartSLOduration=1.291125475 podStartE2EDuration="1.291125475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:34:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:34:16.289997364 +0000 UTC m=+1372.336122545" watchObservedRunningTime="2026-09-09 12:34:16.291125475 +0000 UTC m=+1372.337250665"
Sep 09 12:34:25.717854 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:25.717824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:25.717854 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:25.717863    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:25.730026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:25.730003    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:26.343805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:26.343778    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:34:27.636989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:27.636948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:38.436510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:38.436466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:38.528036 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:38.528006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:34:43.029752 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.029718    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"]
Sep 09 12:34:43.030144 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.029940    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2" podUID="9eb3c817-ae1b-404a-8009-9321d172ae6b" containerName="maas-api" containerID="cri-o://8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095" gracePeriod=30
Sep 09 12:34:43.094773 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.094730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:43.195062 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.195030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:43.285711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.285654    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:34:43.293493 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.293466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:43.356779 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.356749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g277s\" (UniqueName: \"kubernetes.io/projected/9eb3c817-ae1b-404a-8009-9321d172ae6b-kube-api-access-g277s\") pod \"9eb3c817-ae1b-404a-8009-9321d172ae6b\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") "
Sep 09 12:34:43.356926 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.356814    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb3c817-ae1b-404a-8009-9321d172ae6b-openshift-service-ca\") pod \"9eb3c817-ae1b-404a-8009-9321d172ae6b\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") "
Sep 09 12:34:43.356988 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.356972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-metrics-certs\") pod \"9eb3c817-ae1b-404a-8009-9321d172ae6b\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") "
Sep 09 12:34:43.357096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.357081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls\") pod \"9eb3c817-ae1b-404a-8009-9321d172ae6b\" (UID: \"9eb3c817-ae1b-404a-8009-9321d172ae6b\") "
Sep 09 12:34:43.357172 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.357139    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eb3c817-ae1b-404a-8009-9321d172ae6b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9eb3c817-ae1b-404a-8009-9321d172ae6b" (UID: "9eb3c817-ae1b-404a-8009-9321d172ae6b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:34:43.357445 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.357426    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb3c817-ae1b-404a-8009-9321d172ae6b-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:34:43.358982 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.358953    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb3c817-ae1b-404a-8009-9321d172ae6b-kube-api-access-g277s" (OuterVolumeSpecName: "kube-api-access-g277s") pod "9eb3c817-ae1b-404a-8009-9321d172ae6b" (UID: "9eb3c817-ae1b-404a-8009-9321d172ae6b"). InnerVolumeSpecName "kube-api-access-g277s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:34:43.359065 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.358975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9eb3c817-ae1b-404a-8009-9321d172ae6b" (UID: "9eb3c817-ae1b-404a-8009-9321d172ae6b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:34:43.359065 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.358961    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9eb3c817-ae1b-404a-8009-9321d172ae6b" (UID: "9eb3c817-ae1b-404a-8009-9321d172ae6b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:34:43.367645 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.367618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:43.457386 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.454823    2560 generic.go:356] "Generic (PLEG): container finished" podID="9eb3c817-ae1b-404a-8009-9321d172ae6b" containerID="8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095" exitCode=0
Sep 09 12:34:43.457386 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.455023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2" event={"ID":"9eb3c817-ae1b-404a-8009-9321d172ae6b","Type":"ContainerDied","Data":"8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095"}
Sep 09 12:34:43.457386 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.455073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2" event={"ID":"9eb3c817-ae1b-404a-8009-9321d172ae6b","Type":"ContainerDied","Data":"acbd1901142fab3af23aa9dee293ed331ba7615c1f510707801c8cea78939b30"}
Sep 09 12:34:43.457386 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.455102    2560 scope.go:117] "RemoveContainer" containerID="8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095"
Sep 09 12:34:43.457386 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.455278    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"
Sep 09 12:34:43.459862 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.459755    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:34:43.459862 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.459787    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eb3c817-ae1b-404a-8009-9321d172ae6b-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:34:43.459862 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.459802    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g277s\" (UniqueName: \"kubernetes.io/projected/9eb3c817-ae1b-404a-8009-9321d172ae6b-kube-api-access-g277s\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:34:43.475657 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.474599    2560 scope.go:117] "RemoveContainer" containerID="8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095"
Sep 09 12:34:43.476779 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:34:43.475869    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095\": container with ID starting with 8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095 not found: ID does not exist" containerID="8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095"
Sep 09 12:34:43.476779 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.475908    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095"} err="failed to get container status \"8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095\": rpc error: code = NotFound desc = could not find container \"8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095\": container with ID starting with 8c03629cacf8a9c2d7213dd273d2e016c4c22c67e760233cb2c58f651e647095 not found: ID does not exist"
Sep 09 12:34:43.489026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.488999    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"]
Sep 09 12:34:43.493880 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:43.493851    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-24ec44a5-5c846555ff-shqd2"]
Sep 09 12:34:44.402920 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:44.402887    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eb3c817-ae1b-404a-8009-9321d172ae6b" path="/var/lib/kubelet/pods/9eb3c817-ae1b-404a-8009-9321d172ae6b/volumes"
Sep 09 12:34:47.128748 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:47.128709    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:52.208101 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:52.208068    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:57.014458 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:57.014413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:57.114091 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:57.114052    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:34:58.742222 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:34:58.742184    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:02.129283 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:02.129242    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:02.865246 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:02.865206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:03.614548 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:03.614515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:07.453137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:07.453090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:13.272162 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.272124    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"]
Sep 09 12:35:13.272635 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.272446    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl" podUID="5d926fd0-e167-4225-8457-f823b17d93bb" containerName="maas-api" containerID="cri-o://d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f" gracePeriod=30
Sep 09 12:35:13.301699 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.301669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:13.404109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.404077    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:13.417537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.417223    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl" podUID="5d926fd0-e167-4225-8457-f823b17d93bb" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.55:8443/health\": dial tcp 10.134.0.55:8443: connect: connection refused"
Sep 09 12:35:13.505468 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.505418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:13.535174 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.535116    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:35:13.557111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.557081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-maas-api-tls\") pod \"5d926fd0-e167-4225-8457-f823b17d93bb\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") "
Sep 09 12:35:13.557111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.557112    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d926fd0-e167-4225-8457-f823b17d93bb-openshift-service-ca\") pod \"5d926fd0-e167-4225-8457-f823b17d93bb\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") "
Sep 09 12:35:13.557343 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.557217    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-metrics-certs\") pod \"5d926fd0-e167-4225-8457-f823b17d93bb\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") "
Sep 09 12:35:13.557343 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.557254    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5rl9\" (UniqueName: \"kubernetes.io/projected/5d926fd0-e167-4225-8457-f823b17d93bb-kube-api-access-f5rl9\") pod \"5d926fd0-e167-4225-8457-f823b17d93bb\" (UID: \"5d926fd0-e167-4225-8457-f823b17d93bb\") "
Sep 09 12:35:13.557555 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.557526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d926fd0-e167-4225-8457-f823b17d93bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d926fd0-e167-4225-8457-f823b17d93bb" (UID: "5d926fd0-e167-4225-8457-f823b17d93bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:35:13.559327 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.559276    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d926fd0-e167-4225-8457-f823b17d93bb" (UID: "5d926fd0-e167-4225-8457-f823b17d93bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:35:13.559455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.559333    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5d926fd0-e167-4225-8457-f823b17d93bb" (UID: "5d926fd0-e167-4225-8457-f823b17d93bb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:35:13.559606 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.559579    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d926fd0-e167-4225-8457-f823b17d93bb-kube-api-access-f5rl9" (OuterVolumeSpecName: "kube-api-access-f5rl9") pod "5d926fd0-e167-4225-8457-f823b17d93bb" (UID: "5d926fd0-e167-4225-8457-f823b17d93bb"). InnerVolumeSpecName "kube-api-access-f5rl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:35:13.608981 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.608938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:13.648303 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.648267    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d926fd0-e167-4225-8457-f823b17d93bb" containerID="d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f" exitCode=0
Sep 09 12:35:13.648469 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.648329    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"
Sep 09 12:35:13.648469 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.648357    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl" event={"ID":"5d926fd0-e167-4225-8457-f823b17d93bb","Type":"ContainerDied","Data":"d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f"}
Sep 09 12:35:13.648469 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.648422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl" event={"ID":"5d926fd0-e167-4225-8457-f823b17d93bb","Type":"ContainerDied","Data":"5a4501c1a08e8a38936b41443529ea5cb9946e1ddd8511922ff030410b2ea1a9"}
Sep 09 12:35:13.648469 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.648444    2560 scope.go:117] "RemoveContainer" containerID="d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f"
Sep 09 12:35:13.658684 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.658661    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:13.658684 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.658684    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5rl9\" (UniqueName: \"kubernetes.io/projected/5d926fd0-e167-4225-8457-f823b17d93bb-kube-api-access-f5rl9\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:13.658866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.658693    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d926fd0-e167-4225-8457-f823b17d93bb-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:13.658866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.658702    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d926fd0-e167-4225-8457-f823b17d93bb-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:13.660894 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.660874    2560 scope.go:117] "RemoveContainer" containerID="d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f"
Sep 09 12:35:13.661192 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:35:13.661170    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f\": container with ID starting with d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f not found: ID does not exist" containerID="d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f"
Sep 09 12:35:13.661260 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.661199    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f"} err="failed to get container status \"d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f\": rpc error: code = NotFound desc = could not find container \"d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f\": container with ID starting with d21b9d12fef440936891d64b09ad087398fd4ff43d06e7b4e7d4337232e7f02f not found: ID does not exist"
Sep 09 12:35:13.678680 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.676625    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"]
Sep 09 12:35:13.688786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.688750    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c554db-6bcb48f67f-zs4jl"]
Sep 09 12:35:13.941837 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:13.941799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:14.401148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:14.401108    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d926fd0-e167-4225-8457-f823b17d93bb" path="/var/lib/kubelet/pods/5d926fd0-e167-4225-8457-f823b17d93bb/volumes"
Sep 09 12:35:18.117570 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:18.117490    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:35:20.578741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:20.578705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:20.666671 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:20.666627    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:20.874812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:20.874713    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:27.926465 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:27.926433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:28.619959 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:28.619926    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:29.860621 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:29.860586    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:35.766929 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:35.766889    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:37.304692 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:37.304660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:38.174863 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:38.174827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:38.274115 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:38.274069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:40.018651 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:40.018612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:44.848281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:44.848229    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:44.948667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:44.948631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:45.110919 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:45.110838    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"]
Sep 09 12:35:45.111150 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:45.111124    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy" containerID="cri-o://5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6" gracePeriod=30
Sep 09 12:35:45.136782 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:45.136740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:45.888941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:45.888902    2560 patch_prober.go:28] interesting pod/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 12:35:45.889339 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:45.888957    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 12:35:46.378802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:46.378766    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:46.480087 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:46.480056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:46.584590 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:46.584541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:46.682153 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:46.682061    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:47.339791 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:47.339750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:47.467672 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:47.467639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:47.565234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:47.565174    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:49.016847 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:49.016796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:50.366315 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.366277    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:35:50.434509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-istio-token\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.434509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434476    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-envoy\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.434509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434498    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f53054f8-19e3-4d22-99c3-85e7146de220-istiod-ca-cert\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.434768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434528    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-socket\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.434768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434551    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-credential-socket\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.434768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qng7n\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-kube-api-access-qng7n\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.434768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434661    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-data\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.434768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-certs\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.435031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434794    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f53054f8-19e3-4d22-99c3-85e7146de220-istio-podinfo\") pod \"f53054f8-19e3-4d22-99c3-85e7146de220\" (UID: \"f53054f8-19e3-4d22-99c3-85e7146de220\") "
Sep 09 12:35:50.435031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434882    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:35:50.435031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434968    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f53054f8-19e3-4d22-99c3-85e7146de220-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:35:50.435031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.434876    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:35:50.435251 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.435103    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-data" (OuterVolumeSpecName: "istio-data") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:35:50.435251 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.435207    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:35:50.435405 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.435375    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f53054f8-19e3-4d22-99c3-85e7146de220-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.435405 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.435398    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.435521 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.435412    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.435521 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.435427    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.435521 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.435442    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.436739 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.436717    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-istio-token" (OuterVolumeSpecName: "istio-token") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:35:50.436848 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.436820    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:35:50.436848 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.436829    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-kube-api-access-qng7n" (OuterVolumeSpecName: "kube-api-access-qng7n") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "kube-api-access-qng7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:35:50.436920 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.436882    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f53054f8-19e3-4d22-99c3-85e7146de220-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f53054f8-19e3-4d22-99c3-85e7146de220" (UID: "f53054f8-19e3-4d22-99c3-85e7146de220"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:35:50.536016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.535983    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f53054f8-19e3-4d22-99c3-85e7146de220-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.536016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.536010    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.536016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.536020    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f53054f8-19e3-4d22-99c3-85e7146de220-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.536236 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.536028    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qng7n\" (UniqueName: \"kubernetes.io/projected/f53054f8-19e3-4d22-99c3-85e7146de220-kube-api-access-qng7n\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:35:50.873982 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.873948    2560 generic.go:356] "Generic (PLEG): container finished" podID="f53054f8-19e3-4d22-99c3-85e7146de220" containerID="5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6" exitCode=0
Sep 09 12:35:50.874149 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.873997    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"
Sep 09 12:35:50.874149 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.874025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" event={"ID":"f53054f8-19e3-4d22-99c3-85e7146de220","Type":"ContainerDied","Data":"5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6"}
Sep 09 12:35:50.874149 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.874074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh" event={"ID":"f53054f8-19e3-4d22-99c3-85e7146de220","Type":"ContainerDied","Data":"e9e7fdaf9649ed26881a253d081127711146d1cfbe2fe7431bda14d8ddd6e6d8"}
Sep 09 12:35:50.874149 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.874096    2560 scope.go:117] "RemoveContainer" containerID="5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6"
Sep 09 12:35:50.884012 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.883995    2560 scope.go:117] "RemoveContainer" containerID="c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6"
Sep 09 12:35:50.892374 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.892358    2560 scope.go:117] "RemoveContainer" containerID="5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6"
Sep 09 12:35:50.892613 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:35:50.892596    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6\": container with ID starting with 5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6 not found: ID does not exist" containerID="5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6"
Sep 09 12:35:50.892668 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.892621    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6"} err="failed to get container status \"5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6\": rpc error: code = NotFound desc = could not find container \"5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6\": container with ID starting with 5240518d2ca92846f60b384784a5c64bf0ada52da4ca7e684dd40d6d659beff6 not found: ID does not exist"
Sep 09 12:35:50.892668 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.892653    2560 scope.go:117] "RemoveContainer" containerID="c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6"
Sep 09 12:35:50.892915 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:35:50.892894    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6\": container with ID starting with c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6 not found: ID does not exist" containerID="c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6"
Sep 09 12:35:50.893001 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.892921    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6"} err="failed to get container status \"c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6\": rpc error: code = NotFound desc = could not find container \"c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6\": container with ID starting with c7fc69fdab7328325452c1cc2c3d82659b09d0395450d2122ebfb09c332420a6 not found: ID does not exist"
Sep 09 12:35:50.899048 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.899019    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"]
Sep 09 12:35:50.905708 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:50.905688    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-24ec44a5-openshift-default-6bb5597cfb-wr9hh"]
Sep 09 12:35:51.237719 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:51.237629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:52.407761 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:52.407724    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" path="/var/lib/kubelet/pods/f53054f8-19e3-4d22-99c3-85e7146de220/volumes"
Sep 09 12:35:55.462168 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:55.462134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:55.564041 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:55.564003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:56.189716 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:56.189687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:35:56.664223 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:56.664187    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:35:57.741686 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:35:57.741644    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:02.786392 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:02.786338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:02.898942 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:02.898905    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:03.012727 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:03.012688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:14.586181 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:14.586129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:14.699878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:14.699842    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:23.615073 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:23.615028    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:36:24.463704 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:24.463677    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:36:24.475427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:24.475407    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:36:34.795307 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:34.795264    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:37.513024 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:37.512980    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:39.514449 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:39.514416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:41.321213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:41.321148    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:41.422941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:41.422903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:41.651454 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:41.651370    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:41.962959 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:41.962871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:42.142509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:42.142473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:45.264220 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:45.264186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:45.361712 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:45.361672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:46.510227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510193    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"]
Sep 09 12:36:46.510758 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510741    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eb3c817-ae1b-404a-8009-9321d172ae6b" containerName="maas-api"
Sep 09 12:36:46.510758 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510759    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eb3c817-ae1b-404a-8009-9321d172ae6b" containerName="maas-api"
Sep 09 12:36:46.510891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510771    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy"
Sep 09 12:36:46.510891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510777    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy"
Sep 09 12:36:46.510891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510792    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d926fd0-e167-4225-8457-f823b17d93bb" containerName="maas-api"
Sep 09 12:36:46.510891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510798    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d926fd0-e167-4225-8457-f823b17d93bb" containerName="maas-api"
Sep 09 12:36:46.510891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510877    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eb3c817-ae1b-404a-8009-9321d172ae6b" containerName="maas-api"
Sep 09 12:36:46.510891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510884    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy"
Sep 09 12:36:46.510891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510891    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy"
Sep 09 12:36:46.511226 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.510899    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d926fd0-e167-4225-8457-f823b17d93bb" containerName="maas-api"
Sep 09 12:36:46.514082 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.514062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.516523 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.516498    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-364341-serving-cert\""
Sep 09 12:36:46.523447 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.523422    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"]
Sep 09 12:36:46.544519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.544484    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:46.598275 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.598243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-maas-api-tls\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.598473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.598330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpbhr\" (UniqueName: \"kubernetes.io/projected/97e820cb-4523-4053-a758-e7bd409bde6d-kube-api-access-xpbhr\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.598473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.598391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-metrics-certs\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.598473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.598410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97e820cb-4523-4053-a758-e7bd409bde6d-openshift-service-ca\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.629981 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.629948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:46.699177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.699142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpbhr\" (UniqueName: \"kubernetes.io/projected/97e820cb-4523-4053-a758-e7bd409bde6d-kube-api-access-xpbhr\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.699429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.699204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-metrics-certs\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.699429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.699229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97e820cb-4523-4053-a758-e7bd409bde6d-openshift-service-ca\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.699429 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.699279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-maas-api-tls\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.699968 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.699938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97e820cb-4523-4053-a758-e7bd409bde6d-openshift-service-ca\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.701688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.701667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-maas-api-tls\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.701794 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.701692    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-metrics-certs\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.707988 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.707963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpbhr\" (UniqueName: \"kubernetes.io/projected/97e820cb-4523-4053-a758-e7bd409bde6d-kube-api-access-xpbhr\") pod \"maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:46.729585 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.729557    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:46.827061 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:46.827026    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:47.102171 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:47.102137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"]
Sep 09 12:36:47.103004 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:36:47.102976    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e820cb_4523_4053_a758_e7bd409bde6d.slice/crio-8ac8d3e5070a38e4d73392f0cabd752c533f6bd40b57cfb13fe584f0c22bf451 WatchSource:0}: Error finding container 8ac8d3e5070a38e4d73392f0cabd752c533f6bd40b57cfb13fe584f0c22bf451: Status 404 returned error can't find the container with id 8ac8d3e5070a38e4d73392f0cabd752c533f6bd40b57cfb13fe584f0c22bf451
Sep 09 12:36:47.124235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:47.124208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:47.210511 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:47.210476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2" event={"ID":"97e820cb-4523-4053-a758-e7bd409bde6d","Type":"ContainerStarted","Data":"8ac8d3e5070a38e4d73392f0cabd752c533f6bd40b57cfb13fe584f0c22bf451"}
Sep 09 12:36:47.230241 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:47.230210    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:36:48.219050 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:48.219018    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2" event={"ID":"97e820cb-4523-4053-a758-e7bd409bde6d","Type":"ContainerStarted","Data":"978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c"}
Sep 09 12:36:48.219453 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:48.219147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:36:48.238703 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:48.238641    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2" podStartSLOduration=1.655750324 podStartE2EDuration="2.238623789s" totalImagesPullingTime="582.873465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:36:48.236243011 +0000 UTC m=+1524.282368190" watchObservedRunningTime="2026-09-09 12:36:48.238623789 +0000 UTC m=+1524.284748967"
Sep 09 12:36:53.216722 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:53.216681    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:36:54.231509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:36:54.231474    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:37:10.308032 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:10.307993    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:12.333962 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:12.333932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:14.386841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:14.386807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:14.486513 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:14.486483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:15.504526 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.504495    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"]
Sep 09 12:37:15.505028 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.505012    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy"
Sep 09 12:37:15.505075 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.505030    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53054f8-19e3-4d22-99c3-85e7146de220" containerName="istio-proxy"
Sep 09 12:37:15.508469 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.508452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.510996 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.510975    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-59ce1d-serving-cert\""
Sep 09 12:37:15.523868 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.523846    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"]
Sep 09 12:37:15.547381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.547338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:15.592904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.592872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-metrics-certs\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.593071 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.592974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.593071 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.593015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-openshift-service-ca\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.593071 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.593033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvbps\" (UniqueName: \"kubernetes.io/projected/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-kube-api-access-dvbps\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.649341 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.649279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:15.694234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.694193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-metrics-certs\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.694431 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.694281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.694431 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.694332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-openshift-service-ca\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.694431 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.694352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvbps\" (UniqueName: \"kubernetes.io/projected/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-kube-api-access-dvbps\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.694575 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:37:15.694449    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-serving-cert: secret "maas-api-e2e-api-b-59ce1d-serving-cert" not found
Sep 09 12:37:15.694575 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:37:15.694533    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls podName:9c41c14c-07cf-48b9-a0ef-efa50a4d2c64 nodeName:}" failed. No retries permitted until 2026-09-09 12:37:16.194511643 +0000 UTC m=+1552.240636811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls") pod "maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z" (UID: "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64") : secret "maas-api-e2e-api-b-59ce1d-serving-cert" not found
Sep 09 12:37:15.695001 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.694984    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-openshift-service-ca\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.696632 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.696615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-metrics-certs\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.705378 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.705357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvbps\" (UniqueName: \"kubernetes.io/projected/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-kube-api-access-dvbps\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:15.875235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:15.875195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:16.058635 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:16.058602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:16.153062 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:16.152977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:16.200010 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:16.199974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:16.202533 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:16.202505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls\") pod \"maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:16.422484 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:16.422396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:16.533195 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:16.533150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:16.701144 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:16.701113    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"]
Sep 09 12:37:16.705916 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:37:16.702666    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c41c14c_07cf_48b9_a0ef_efa50a4d2c64.slice/crio-882e7243f77a65fb3d7fc6725269740a5f76276d9e0bbb909a12e5ff966f626c WatchSource:0}: Error finding container 882e7243f77a65fb3d7fc6725269740a5f76276d9e0bbb909a12e5ff966f626c: Status 404 returned error can't find the container with id 882e7243f77a65fb3d7fc6725269740a5f76276d9e0bbb909a12e5ff966f626c
Sep 09 12:37:17.340637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:17.340558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:17.397461 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:17.397410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z" event={"ID":"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64","Type":"ContainerStarted","Data":"411a24408d852615cbeebff4c0a4bc4930a29c767d723e1f43ec9c58dab12c30"}
Sep 09 12:37:17.397708 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:17.397473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z" event={"ID":"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64","Type":"ContainerStarted","Data":"882e7243f77a65fb3d7fc6725269740a5f76276d9e0bbb909a12e5ff966f626c"}
Sep 09 12:37:17.397708 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:17.397495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:17.416891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:17.416831    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z" podStartSLOduration=2.054059413 podStartE2EDuration="2.416811935s" totalImagesPullingTime="362.752522ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:37:17.416571837 +0000 UTC m=+1553.462697018" watchObservedRunningTime="2026-09-09 12:37:17.416811935 +0000 UTC m=+1553.462937115"
Sep 09 12:37:23.407638 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:23.407599    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:37:27.836117 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:27.836078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:28.249647 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:28.249560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:30.758754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:30.758716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:30.818751 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:30.818714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:31.117118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:31.117081    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:37:36.669672 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:36.669639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:39.469797 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:39.469749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:42.993893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:42.993857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:56.624097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:56.624058    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:58.367313 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.367091    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"]
Sep 09 12:37:58.367831 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.367342    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2" podUID="97e820cb-4523-4053-a758-e7bd409bde6d" containerName="maas-api" containerID="cri-o://978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c" gracePeriod=30
Sep 09 12:37:58.394994 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.394950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:58.480883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.480844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:58.574106 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.574066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:58.620153 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.620095    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:37:58.639899 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.639869    2560 generic.go:356] "Generic (PLEG): container finished" podID="97e820cb-4523-4053-a758-e7bd409bde6d" containerID="978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c" exitCode=0
Sep 09 12:37:58.640054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.639925    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"
Sep 09 12:37:58.640054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.639970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2" event={"ID":"97e820cb-4523-4053-a758-e7bd409bde6d","Type":"ContainerDied","Data":"978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c"}
Sep 09 12:37:58.640054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.640027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2" event={"ID":"97e820cb-4523-4053-a758-e7bd409bde6d","Type":"ContainerDied","Data":"8ac8d3e5070a38e4d73392f0cabd752c533f6bd40b57cfb13fe584f0c22bf451"}
Sep 09 12:37:58.640187 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.640058    2560 scope.go:117] "RemoveContainer" containerID="978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c"
Sep 09 12:37:58.646139 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.646087    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:58.654134 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.654106    2560 scope.go:117] "RemoveContainer" containerID="978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c"
Sep 09 12:37:58.654481 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:37:58.654455    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c\": container with ID starting with 978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c not found: ID does not exist" containerID="978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c"
Sep 09 12:37:58.654558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.654496    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c"} err="failed to get container status \"978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c\": rpc error: code = NotFound desc = could not find container \"978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c\": container with ID starting with 978b9af712591ea0c159c3e3191b571ebdcc177df73b053a30b1e3641e0d495c not found: ID does not exist"
Sep 09 12:37:58.723087 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.723047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:37:58.749916 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.749887    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpbhr\" (UniqueName: \"kubernetes.io/projected/97e820cb-4523-4053-a758-e7bd409bde6d-kube-api-access-xpbhr\") pod \"97e820cb-4523-4053-a758-e7bd409bde6d\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") "
Sep 09 12:37:58.750070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.749933    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97e820cb-4523-4053-a758-e7bd409bde6d-openshift-service-ca\") pod \"97e820cb-4523-4053-a758-e7bd409bde6d\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") "
Sep 09 12:37:58.750070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.750027    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-maas-api-tls\") pod \"97e820cb-4523-4053-a758-e7bd409bde6d\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") "
Sep 09 12:37:58.750163 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.750070    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-metrics-certs\") pod \"97e820cb-4523-4053-a758-e7bd409bde6d\" (UID: \"97e820cb-4523-4053-a758-e7bd409bde6d\") "
Sep 09 12:37:58.750384 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.750353    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e820cb-4523-4053-a758-e7bd409bde6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97e820cb-4523-4053-a758-e7bd409bde6d" (UID: "97e820cb-4523-4053-a758-e7bd409bde6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:37:58.753127 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.752995    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "97e820cb-4523-4053-a758-e7bd409bde6d" (UID: "97e820cb-4523-4053-a758-e7bd409bde6d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:37:58.753127 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.753098    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e820cb-4523-4053-a758-e7bd409bde6d-kube-api-access-xpbhr" (OuterVolumeSpecName: "kube-api-access-xpbhr") pod "97e820cb-4523-4053-a758-e7bd409bde6d" (UID: "97e820cb-4523-4053-a758-e7bd409bde6d"). InnerVolumeSpecName "kube-api-access-xpbhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:37:58.753540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.753502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97e820cb-4523-4053-a758-e7bd409bde6d" (UID: "97e820cb-4523-4053-a758-e7bd409bde6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:37:58.851200 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.851165    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:37:58.851200 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.851195    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97e820cb-4523-4053-a758-e7bd409bde6d-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:37:58.851200 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.851207    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpbhr\" (UniqueName: \"kubernetes.io/projected/97e820cb-4523-4053-a758-e7bd409bde6d-kube-api-access-xpbhr\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:37:58.851478 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.851216    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97e820cb-4523-4053-a758-e7bd409bde6d-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:37:58.964596 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.964566    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"]
Sep 09 12:37:58.969183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:58.969158    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-364341-7c85fb7d4c-jqfr2"]
Sep 09 12:37:59.041680 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:37:59.041640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:00.401241 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:00.401206    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e820cb-4523-4053-a758-e7bd409bde6d" path="/var/lib/kubelet/pods/97e820cb-4523-4053-a758-e7bd409bde6d/volumes"
Sep 09 12:38:05.399178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:05.399144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:05.499502 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:05.499471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:05.625368 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:05.625335    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:38:05.697037 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:05.696942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:06.234637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:06.234603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:21.575852 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.575765    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"]
Sep 09 12:38:21.576411 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.576086    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z" podUID="9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" containerName="maas-api" containerID="cri-o://411a24408d852615cbeebff4c0a4bc4930a29c767d723e1f43ec9c58dab12c30" gracePeriod=30
Sep 09 12:38:21.599069 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.599040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:21.699625 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.699573    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:21.788660 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.788631    2560 generic.go:356] "Generic (PLEG): container finished" podID="9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" containerID="411a24408d852615cbeebff4c0a4bc4930a29c767d723e1f43ec9c58dab12c30" exitCode=0
Sep 09 12:38:21.788848 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.788702    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z" event={"ID":"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64","Type":"ContainerDied","Data":"411a24408d852615cbeebff4c0a4bc4930a29c767d723e1f43ec9c58dab12c30"}
Sep 09 12:38:21.798559 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.798525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:21.824594 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.824572    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:38:21.857036 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.856956    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:21.876889 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.876863    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-openshift-service-ca\") pod \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") "
Sep 09 12:38:21.877024 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.876912    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls\") pod \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") "
Sep 09 12:38:21.877024 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.876984    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-metrics-certs\") pod \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") "
Sep 09 12:38:21.877117 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.877023    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvbps\" (UniqueName: \"kubernetes.io/projected/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-kube-api-access-dvbps\") pod \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\" (UID: \"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64\") "
Sep 09 12:38:21.877237 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.877210    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" (UID: "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:38:21.877394 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.877371    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:21.879013 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.878983    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" (UID: "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:38:21.879108 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.879029    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" (UID: "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:38:21.879163 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.879122    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-kube-api-access-dvbps" (OuterVolumeSpecName: "kube-api-access-dvbps") pod "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" (UID: "9c41c14c-07cf-48b9-a0ef-efa50a4d2c64"). InnerVolumeSpecName "kube-api-access-dvbps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:38:21.978305 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.978238    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:21.978305 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.978271    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:21.978305 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:21.978288    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvbps\" (UniqueName: \"kubernetes.io/projected/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64-kube-api-access-dvbps\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:22.579209 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:22.579178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:22.800576 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:22.800461    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"
Sep 09 12:38:22.800576 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:22.800507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z" event={"ID":"9c41c14c-07cf-48b9-a0ef-efa50a4d2c64","Type":"ContainerDied","Data":"882e7243f77a65fb3d7fc6725269740a5f76276d9e0bbb909a12e5ff966f626c"}
Sep 09 12:38:22.800825 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:22.800589    2560 scope.go:117] "RemoveContainer" containerID="411a24408d852615cbeebff4c0a4bc4930a29c767d723e1f43ec9c58dab12c30"
Sep 09 12:38:22.823396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:22.823354    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"]
Sep 09 12:38:22.826581 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:22.826553    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-59ce1d-d6d796f46-cxx9z"]
Sep 09 12:38:24.400203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:24.400171    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" path="/var/lib/kubelet/pods/9c41c14c-07cf-48b9-a0ef-efa50a4d2c64/volumes"
Sep 09 12:38:29.017744 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:29.017713    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:29.091648 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:29.091604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:29.314248 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:29.314212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:29.870133 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:29.870099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:34.324930 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:34.324896    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:38:40.200857 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.200819    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"]
Sep 09 12:38:40.201253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.201076    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4" podUID="e97add39-0d65-43f4-809d-03c21a059870" containerName="maas-api" containerID="cri-o://0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516" gracePeriod=30
Sep 09 12:38:40.243667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.243630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:40.346908 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.346862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:40.468956 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.468929    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:38:40.477695 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.477656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:40.565368 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.565285    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-metrics-certs\") pod \"e97add39-0d65-43f4-809d-03c21a059870\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") "
Sep 09 12:38:40.565619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.565434    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97add39-0d65-43f4-809d-03c21a059870-openshift-service-ca\") pod \"e97add39-0d65-43f4-809d-03c21a059870\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") "
Sep 09 12:38:40.565619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.565461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-maas-api-tls\") pod \"e97add39-0d65-43f4-809d-03c21a059870\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") "
Sep 09 12:38:40.565619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.565531    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6bvm\" (UniqueName: \"kubernetes.io/projected/e97add39-0d65-43f4-809d-03c21a059870-kube-api-access-p6bvm\") pod \"e97add39-0d65-43f4-809d-03c21a059870\" (UID: \"e97add39-0d65-43f4-809d-03c21a059870\") "
Sep 09 12:38:40.565890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.565858    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e97add39-0d65-43f4-809d-03c21a059870-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e97add39-0d65-43f4-809d-03c21a059870" (UID: "e97add39-0d65-43f4-809d-03c21a059870"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:38:40.567583 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.567554    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e97add39-0d65-43f4-809d-03c21a059870" (UID: "e97add39-0d65-43f4-809d-03c21a059870"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:38:40.567764 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.567735    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e97add39-0d65-43f4-809d-03c21a059870-kube-api-access-p6bvm" (OuterVolumeSpecName: "kube-api-access-p6bvm") pod "e97add39-0d65-43f4-809d-03c21a059870" (UID: "e97add39-0d65-43f4-809d-03c21a059870"). InnerVolumeSpecName "kube-api-access-p6bvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:38:40.567863 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.567787    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e97add39-0d65-43f4-809d-03c21a059870" (UID: "e97add39-0d65-43f4-809d-03c21a059870"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:38:40.574417 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.574378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:40.666719 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.666679    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:40.666719 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.666712    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97add39-0d65-43f4-809d-03c21a059870-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:40.666719 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.666724    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e97add39-0d65-43f4-809d-03c21a059870-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:40.666967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.666734    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6bvm\" (UniqueName: \"kubernetes.io/projected/e97add39-0d65-43f4-809d-03c21a059870-kube-api-access-p6bvm\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:40.911923 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.911890    2560 generic.go:356] "Generic (PLEG): container finished" podID="e97add39-0d65-43f4-809d-03c21a059870" containerID="0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516" exitCode=0
Sep 09 12:38:40.912111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.911936    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"
Sep 09 12:38:40.912111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.911970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4" event={"ID":"e97add39-0d65-43f4-809d-03c21a059870","Type":"ContainerDied","Data":"0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516"}
Sep 09 12:38:40.912111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.912022    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4" event={"ID":"e97add39-0d65-43f4-809d-03c21a059870","Type":"ContainerDied","Data":"657e13dc98b2b0af0ca80b7d29f13b0a61b87c76225efa91bb146661b83581d7"}
Sep 09 12:38:40.912111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.912043    2560 scope.go:117] "RemoveContainer" containerID="0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516"
Sep 09 12:38:40.921822 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.921805    2560 scope.go:117] "RemoveContainer" containerID="0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516"
Sep 09 12:38:40.922088 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:38:40.922068    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516\": container with ID starting with 0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516 not found: ID does not exist" containerID="0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516"
Sep 09 12:38:40.922137 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.922097    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516"} err="failed to get container status \"0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516\": rpc error: code = NotFound desc = could not find container \"0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516\": container with ID starting with 0bedc46d46482ceee828a889169cb530c2de7a2cb378ffe10e0f9b73c1752516 not found: ID does not exist"
Sep 09 12:38:40.946443 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.946417    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"]
Sep 09 12:38:40.948892 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.948871    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d1f639-845b777858-5qpp4"]
Sep 09 12:38:40.956282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:40.956259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:42.400813 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:42.400775    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e97add39-0d65-43f4-809d-03c21a059870" path="/var/lib/kubelet/pods/e97add39-0d65-43f4-809d-03c21a059870/volumes"
Sep 09 12:38:42.679771 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:42.679668    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"]
Sep 09 12:38:42.698696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:42.698656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:44.005565 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:44.005529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:47.138863 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:47.138828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:47.207548 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:47.207519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:47.409195 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:47.409110    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"]
Sep 09 12:38:47.409418 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:47.409389    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy" containerID="cri-o://8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd" gracePeriod=30
Sep 09 12:38:47.437393 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:47.437365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:48.065586 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:48.065542    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:52.680483 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.680413    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:38:52.799884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.799848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4af30259-4d85-4d75-9df1-248f4a1aee7d-istiod-ca-cert\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800108 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.799929    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4m8s\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-kube-api-access-d4m8s\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800108 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.799951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-socket\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800108 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.799973    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-data\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800108 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-envoy\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800108 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-podinfo\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800108 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800108    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-token\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800141    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-credential-socket\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-certs\") pod \"4af30259-4d85-4d75-9df1-248f4a1aee7d\" (UID: \"4af30259-4d85-4d75-9df1-248f4a1aee7d\") "
Sep 09 12:38:52.800467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800266    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:52.800467 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800388    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:52.800677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800568    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:52.800677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:52.800677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800661    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.800677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800677    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.800894 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800690    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.800894 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.800684    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af30259-4d85-4d75-9df1-248f4a1aee7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:38:52.802469 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.802442    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-kube-api-access-d4m8s" (OuterVolumeSpecName: "kube-api-access-d4m8s") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "kube-api-access-d4m8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:38:52.802594 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.802477    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:38:52.802665 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.802648    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:52.802786 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.802761    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4af30259-4d85-4d75-9df1-248f4a1aee7d" (UID: "4af30259-4d85-4d75-9df1-248f4a1aee7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:38:52.902206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.902164    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.902206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.902197    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.902206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.902206    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.902206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.902214    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4af30259-4d85-4d75-9df1-248f4a1aee7d-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.902514 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.902224    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4af30259-4d85-4d75-9df1-248f4a1aee7d-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.902514 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.902233    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4m8s\" (UniqueName: \"kubernetes.io/projected/4af30259-4d85-4d75-9df1-248f4a1aee7d-kube-api-access-d4m8s\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:52.986406 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.986285    2560 generic.go:356] "Generic (PLEG): container finished" podID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerID="8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd" exitCode=0
Sep 09 12:38:52.986406 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.986379    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"
Sep 09 12:38:52.986644 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.986399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" event={"ID":"4af30259-4d85-4d75-9df1-248f4a1aee7d","Type":"ContainerDied","Data":"8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd"}
Sep 09 12:38:52.986644 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.986466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx" event={"ID":"4af30259-4d85-4d75-9df1-248f4a1aee7d","Type":"ContainerDied","Data":"43e4fae3b0872f2ec461cc26caa71547c87e067a61f0c200119c1ab51fd7f162"}
Sep 09 12:38:52.986644 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.986493    2560 scope.go:117] "RemoveContainer" containerID="8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd"
Sep 09 12:38:52.997729 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:52.997708    2560 scope.go:117] "RemoveContainer" containerID="9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b"
Sep 09 12:38:53.010570 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:53.008055    2560 scope.go:117] "RemoveContainer" containerID="8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd"
Sep 09 12:38:53.011064 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:38:53.011038    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd\": container with ID starting with 8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd not found: ID does not exist" containerID="8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd"
Sep 09 12:38:53.011132 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:53.011076    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd"} err="failed to get container status \"8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd\": rpc error: code = NotFound desc = could not find container \"8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd\": container with ID starting with 8c44577cf5ed7cfec1d7c4528f15c6dc35dc02577815b71ae3d78056ab230ecd not found: ID does not exist"
Sep 09 12:38:53.011132 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:53.011097    2560 scope.go:117] "RemoveContainer" containerID="9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b"
Sep 09 12:38:53.011525 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:38:53.011499    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b\": container with ID starting with 9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b not found: ID does not exist" containerID="9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b"
Sep 09 12:38:53.011631 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:53.011532    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b"} err="failed to get container status \"9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b\": rpc error: code = NotFound desc = could not find container \"9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b\": container with ID starting with 9c45033113603997dafceb3395a20eff67afbdc4c9b343f13ddb0a0a2171ba5b not found: ID does not exist"
Sep 09 12:38:53.013191 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:53.013167    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"]
Sep 09 12:38:53.020723 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:53.020691    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d1f639-openshift-default-95d978cfb-nz8bx"]
Sep 09 12:38:54.408820 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:54.408783    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" path="/var/lib/kubelet/pods/4af30259-4d85-4d75-9df1-248f4a1aee7d/volumes"
Sep 09 12:38:55.415615 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:55.415580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:57.593665 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:57.593628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:57.702397 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:57.702336    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z" podUID="34bc2342-6818-44a2-840a-c8a49cd4d2cb" containerName="main" containerID="cri-o://767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d" gracePeriod=45
Sep 09 12:38:57.965416 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:57.965389    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:38:58.021131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.021090    2560 generic.go:356] "Generic (PLEG): container finished" podID="34bc2342-6818-44a2-840a-c8a49cd4d2cb" containerID="767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d" exitCode=0
Sep 09 12:38:58.021131 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.021132    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"
Sep 09 12:38:58.021422 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.021140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z" event={"ID":"34bc2342-6818-44a2-840a-c8a49cd4d2cb","Type":"ContainerDied","Data":"767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d"}
Sep 09 12:38:58.021422 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.021192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z" event={"ID":"34bc2342-6818-44a2-840a-c8a49cd4d2cb","Type":"ContainerDied","Data":"de7f11329a526c65824fd212f0cb5e7afe1f76a55577319d8b6a2b2d7215d395"}
Sep 09 12:38:58.021422 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.021219    2560 scope.go:117] "RemoveContainer" containerID="767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d"
Sep 09 12:38:58.030980 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.030957    2560 scope.go:117] "RemoveContainer" containerID="767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d"
Sep 09 12:38:58.031319 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:38:58.031278    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d\": container with ID starting with 767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d not found: ID does not exist" containerID="767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d"
Sep 09 12:38:58.031378 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.031328    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d"} err="failed to get container status \"767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d\": rpc error: code = NotFound desc = could not find container \"767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d\": container with ID starting with 767edb4f9836f4e35f1a8ca6ea8cd26e0dcad21c4ad223766c6cbaa7b8e17f4d not found: ID does not exist"
Sep 09 12:38:58.044755 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.044718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:58.056841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.056792    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-home\") pod \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") "
Sep 09 12:38:58.056841 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.056855    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sk46\" (UniqueName: \"kubernetes.io/projected/34bc2342-6818-44a2-840a-c8a49cd4d2cb-kube-api-access-2sk46\") pod \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") "
Sep 09 12:38:58.057103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.056873    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-model-cache\") pod \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") "
Sep 09 12:38:58.057103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.056902    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tmp-dir\") pod \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") "
Sep 09 12:38:58.057103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.056958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-dshm\") pod \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") "
Sep 09 12:38:58.057103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.057020    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tls-certs\") pod \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\" (UID: \"34bc2342-6818-44a2-840a-c8a49cd4d2cb\") "
Sep 09 12:38:58.057353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.057125    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-home" (OuterVolumeSpecName: "home") pod "34bc2342-6818-44a2-840a-c8a49cd4d2cb" (UID: "34bc2342-6818-44a2-840a-c8a49cd4d2cb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:58.057353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.057196    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-model-cache" (OuterVolumeSpecName: "model-cache") pod "34bc2342-6818-44a2-840a-c8a49cd4d2cb" (UID: "34bc2342-6818-44a2-840a-c8a49cd4d2cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:58.057353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.057211    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "34bc2342-6818-44a2-840a-c8a49cd4d2cb" (UID: "34bc2342-6818-44a2-840a-c8a49cd4d2cb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:58.057524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.057468    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-home\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:58.057524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.057500    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-model-cache\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:58.057524 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.057518    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tmp-dir\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:58.059226 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.059197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34bc2342-6818-44a2-840a-c8a49cd4d2cb-kube-api-access-2sk46" (OuterVolumeSpecName: "kube-api-access-2sk46") pod "34bc2342-6818-44a2-840a-c8a49cd4d2cb" (UID: "34bc2342-6818-44a2-840a-c8a49cd4d2cb"). InnerVolumeSpecName "kube-api-access-2sk46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:38:58.059423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.059255    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "34bc2342-6818-44a2-840a-c8a49cd4d2cb" (UID: "34bc2342-6818-44a2-840a-c8a49cd4d2cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:38:58.059423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.059391    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-dshm" (OuterVolumeSpecName: "dshm") pod "34bc2342-6818-44a2-840a-c8a49cd4d2cb" (UID: "34bc2342-6818-44a2-840a-c8a49cd4d2cb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:38:58.159100 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.159004    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34bc2342-6818-44a2-840a-c8a49cd4d2cb-tls-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:58.159100 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.159045    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sk46\" (UniqueName: \"kubernetes.io/projected/34bc2342-6818-44a2-840a-c8a49cd4d2cb-kube-api-access-2sk46\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:58.159100 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.159055    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34bc2342-6818-44a2-840a-c8a49cd4d2cb-dshm\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:58.345819 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.345778    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"]
Sep 09 12:38:58.353354 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.353247    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/auth-test-model-679f45-kserve-7f4fbd646c-dfg6z"]
Sep 09 12:38:58.400775 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.400737    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34bc2342-6818-44a2-840a-c8a49cd4d2cb" path="/var/lib/kubelet/pods/34bc2342-6818-44a2-840a-c8a49cd4d2cb/volumes"
Sep 09 12:38:58.697793 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.697753    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"]
Sep 09 12:38:58.698340 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.698037    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh" podUID="c985635f-6a90-425e-80f8-6397c875f7a0" containerName="maas-api" containerID="cri-o://330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7" gracePeriod=30
Sep 09 12:38:58.742264 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.742233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:58.844187 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.844152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:58.952674 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.952638    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:58.968901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:58.968874    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:38:59.029832 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.029799    2560 generic.go:356] "Generic (PLEG): container finished" podID="c985635f-6a90-425e-80f8-6397c875f7a0" containerID="330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7" exitCode=0
Sep 09 12:38:59.030066 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.029844    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"
Sep 09 12:38:59.030066 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.029874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh" event={"ID":"c985635f-6a90-425e-80f8-6397c875f7a0","Type":"ContainerDied","Data":"330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7"}
Sep 09 12:38:59.030066 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.029926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh" event={"ID":"c985635f-6a90-425e-80f8-6397c875f7a0","Type":"ContainerDied","Data":"f56266f033a328fdf3fc9734c9be10d7cac44f1c4b625d8cceaada128b6492c3"}
Sep 09 12:38:59.030066 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.029958    2560 scope.go:117] "RemoveContainer" containerID="330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7"
Sep 09 12:38:59.041592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.041565    2560 scope.go:117] "RemoveContainer" containerID="330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7"
Sep 09 12:38:59.041942 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:38:59.041922    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7\": container with ID starting with 330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7 not found: ID does not exist" containerID="330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7"
Sep 09 12:38:59.041993 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.041953    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7"} err="failed to get container status \"330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7\": rpc error: code = NotFound desc = could not find container \"330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7\": container with ID starting with 330a22b6b82a05155e1c93a4e815b2e62a29592c6b60fc60cd4050280035b0a7 not found: ID does not exist"
Sep 09 12:38:59.052694 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.052646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:38:59.066702 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.066667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-maas-api-tls\") pod \"c985635f-6a90-425e-80f8-6397c875f7a0\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") "
Sep 09 12:38:59.066898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.066717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fq2m\" (UniqueName: \"kubernetes.io/projected/c985635f-6a90-425e-80f8-6397c875f7a0-kube-api-access-9fq2m\") pod \"c985635f-6a90-425e-80f8-6397c875f7a0\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") "
Sep 09 12:38:59.066898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.066736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c985635f-6a90-425e-80f8-6397c875f7a0-openshift-service-ca\") pod \"c985635f-6a90-425e-80f8-6397c875f7a0\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") "
Sep 09 12:38:59.066898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.066768    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-metrics-certs\") pod \"c985635f-6a90-425e-80f8-6397c875f7a0\" (UID: \"c985635f-6a90-425e-80f8-6397c875f7a0\") "
Sep 09 12:38:59.067174 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.067147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c985635f-6a90-425e-80f8-6397c875f7a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c985635f-6a90-425e-80f8-6397c875f7a0" (UID: "c985635f-6a90-425e-80f8-6397c875f7a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:38:59.068992 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.068960    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c985635f-6a90-425e-80f8-6397c875f7a0-kube-api-access-9fq2m" (OuterVolumeSpecName: "kube-api-access-9fq2m") pod "c985635f-6a90-425e-80f8-6397c875f7a0" (UID: "c985635f-6a90-425e-80f8-6397c875f7a0"). InnerVolumeSpecName "kube-api-access-9fq2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:38:59.069083 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.068971    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c985635f-6a90-425e-80f8-6397c875f7a0" (UID: "c985635f-6a90-425e-80f8-6397c875f7a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:38:59.069083 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.068992    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c985635f-6a90-425e-80f8-6397c875f7a0" (UID: "c985635f-6a90-425e-80f8-6397c875f7a0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:38:59.167763 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.167717    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:59.167763 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.167761    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fq2m\" (UniqueName: \"kubernetes.io/projected/c985635f-6a90-425e-80f8-6397c875f7a0-kube-api-access-9fq2m\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:59.167986 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.167776    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c985635f-6a90-425e-80f8-6397c875f7a0-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:59.167986 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.167789    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c985635f-6a90-425e-80f8-6397c875f7a0-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:38:59.354174 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.354131    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"]
Sep 09 12:38:59.359078 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.359045    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-4ec60c-5bb4d6bc57-744gh"]
Sep 09 12:38:59.370930 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:38:59.370895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:00.400220 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:00.400179    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c985635f-6a90-425e-80f8-6397c875f7a0" path="/var/lib/kubelet/pods/c985635f-6a90-425e-80f8-6397c875f7a0/volumes"
Sep 09 12:39:02.676340 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:02.676282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:03.517363 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:03.517328    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:39:05.985132 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:05.985082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:06.089153 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:06.089110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:06.201100 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:06.201060    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"]
Sep 09 12:39:06.201410 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:06.201353    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy" containerID="cri-o://aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4" gracePeriod=30
Sep 09 12:39:06.216186 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:06.216147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:08.895391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:08.895354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:08.957731 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:08.957692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:11.460028 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.460003    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:39:11.587562 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.587524    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-podinfo\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.587741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.587591    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-token\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.587821 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.587804    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-envoy\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.587866 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.587836    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtlvc\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-kube-api-access-xtlvc\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.587917 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.587866    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-data\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.587974 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.587949    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-certs\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.588041 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.587981    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-credential-socket\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.588041 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588024    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istiod-ca-cert\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.588152 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-socket\") pod \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\" (UID: \"8da8c4f2-782d-4ff3-9cfc-e92d10e47930\") "
Sep 09 12:39:11.588219 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588174    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-data" (OuterVolumeSpecName: "istio-data") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:11.588432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:11.588432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588349    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:11.588637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588555    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:39:11.588637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588585    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:11.588869 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588850    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:11.588940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588873    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:11.588940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588888    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:11.588940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588901    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:11.588940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.588913    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:11.589987 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.589964    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-kube-api-access-xtlvc" (OuterVolumeSpecName: "kube-api-access-xtlvc") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "kube-api-access-xtlvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:39:11.590068 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.589968    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:39:11.590234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.590219    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-token" (OuterVolumeSpecName: "istio-token") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:39:11.590305 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.590228    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8da8c4f2-782d-4ff3-9cfc-e92d10e47930" (UID: "8da8c4f2-782d-4ff3-9cfc-e92d10e47930"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:11.690203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.690165    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:11.690203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.690197    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:11.690203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.690207    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:11.690526 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:11.690217    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtlvc\" (UniqueName: \"kubernetes.io/projected/8da8c4f2-782d-4ff3-9cfc-e92d10e47930-kube-api-access-xtlvc\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:12.111343 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.111312    2560 generic.go:356] "Generic (PLEG): container finished" podID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerID="aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4" exitCode=0
Sep 09 12:39:12.111617 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.111377    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" event={"ID":"8da8c4f2-782d-4ff3-9cfc-e92d10e47930","Type":"ContainerDied","Data":"aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4"}
Sep 09 12:39:12.111778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.111712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn" event={"ID":"8da8c4f2-782d-4ff3-9cfc-e92d10e47930","Type":"ContainerDied","Data":"b78ae7f24e536cd47f1142457c3944b7671746c30db65e76c546e22415a74689"}
Sep 09 12:39:12.111778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.111727    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"
Sep 09 12:39:12.111778 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.111742    2560 scope.go:117] "RemoveContainer" containerID="aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4"
Sep 09 12:39:12.128589 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.128573    2560 scope.go:117] "RemoveContainer" containerID="8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0"
Sep 09 12:39:12.137153 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.137122    2560 scope.go:117] "RemoveContainer" containerID="aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4"
Sep 09 12:39:12.137562 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:39:12.137513    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4\": container with ID starting with aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4 not found: ID does not exist" containerID="aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4"
Sep 09 12:39:12.137671 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.137573    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4"} err="failed to get container status \"aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4\": rpc error: code = NotFound desc = could not find container \"aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4\": container with ID starting with aaab6632b3574a658c30b6daa8db7e707c8742369ea6cf6259d93e3ca4f826c4 not found: ID does not exist"
Sep 09 12:39:12.137671 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.137593    2560 scope.go:117] "RemoveContainer" containerID="8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0"
Sep 09 12:39:12.138050 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:39:12.138020    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0\": container with ID starting with 8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0 not found: ID does not exist" containerID="8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0"
Sep 09 12:39:12.138198 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.138059    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0"} err="failed to get container status \"8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0\": rpc error: code = NotFound desc = could not find container \"8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0\": container with ID starting with 8f5946468795058ce8e99ac74c05af5187c55f8a84ebefb1133e03370335cec0 not found: ID does not exist"
Sep 09 12:39:12.140604 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.140581    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"]
Sep 09 12:39:12.145455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.145434    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-4ec60c-openshift-default-5468868bd6-mr5mn"]
Sep 09 12:39:12.400155 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:12.400079    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" path="/var/lib/kubelet/pods/8da8c4f2-782d-4ff3-9cfc-e92d10e47930/volumes"
Sep 09 12:39:13.225716 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.225678    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"]
Sep 09 12:39:13.226178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.225942    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v" podUID="c450cfb0-df51-4ae3-b8b2-3f0497b4f581" containerName="maas-api" containerID="cri-o://0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7" gracePeriod=30
Sep 09 12:39:13.251279 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.251246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:13.352257 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.352219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:13.451757 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.451724    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:13.476314 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.476225    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:39:13.505833 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.505805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqqtg\" (UniqueName: \"kubernetes.io/projected/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-kube-api-access-kqqtg\") pod \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") "
Sep 09 12:39:13.506015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.505864    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-metrics-certs\") pod \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") "
Sep 09 12:39:13.506015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.505899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-maas-api-tls\") pod \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") "
Sep 09 12:39:13.506015 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.505961    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-openshift-service-ca\") pod \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\" (UID: \"c450cfb0-df51-4ae3-b8b2-3f0497b4f581\") "
Sep 09 12:39:13.506458 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.506427    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c450cfb0-df51-4ae3-b8b2-3f0497b4f581" (UID: "c450cfb0-df51-4ae3-b8b2-3f0497b4f581"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:39:13.508244 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.508156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c450cfb0-df51-4ae3-b8b2-3f0497b4f581" (UID: "c450cfb0-df51-4ae3-b8b2-3f0497b4f581"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:39:13.508546 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.508520    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c450cfb0-df51-4ae3-b8b2-3f0497b4f581" (UID: "c450cfb0-df51-4ae3-b8b2-3f0497b4f581"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:39:13.508721 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.508705    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-kube-api-access-kqqtg" (OuterVolumeSpecName: "kube-api-access-kqqtg") pod "c450cfb0-df51-4ae3-b8b2-3f0497b4f581" (UID: "c450cfb0-df51-4ae3-b8b2-3f0497b4f581"). InnerVolumeSpecName "kube-api-access-kqqtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:39:13.556583 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.556549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:13.606918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.606855    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqqtg\" (UniqueName: \"kubernetes.io/projected/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-kube-api-access-kqqtg\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:13.606918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.606893    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:13.606918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.606907    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:13.606918 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.606920    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c450cfb0-df51-4ae3-b8b2-3f0497b4f581-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:13.878086 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:13.878051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:14.125120 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.125088    2560 generic.go:356] "Generic (PLEG): container finished" podID="c450cfb0-df51-4ae3-b8b2-3f0497b4f581" containerID="0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7" exitCode=0
Sep 09 12:39:14.125320 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.125134    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"
Sep 09 12:39:14.125320 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.125173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v" event={"ID":"c450cfb0-df51-4ae3-b8b2-3f0497b4f581","Type":"ContainerDied","Data":"0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7"}
Sep 09 12:39:14.125320 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.125228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v" event={"ID":"c450cfb0-df51-4ae3-b8b2-3f0497b4f581","Type":"ContainerDied","Data":"1fe8a0169ce11f35733b8eb69b82f2be0405b1c4879daeff1d02713e55235bf4"}
Sep 09 12:39:14.125320 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.125254    2560 scope.go:117] "RemoveContainer" containerID="0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7"
Sep 09 12:39:14.134768 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.134750    2560 scope.go:117] "RemoveContainer" containerID="0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7"
Sep 09 12:39:14.135041 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:39:14.135020    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7\": container with ID starting with 0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7 not found: ID does not exist" containerID="0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7"
Sep 09 12:39:14.135086 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.135048    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7"} err="failed to get container status \"0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7\": rpc error: code = NotFound desc = could not find container \"0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7\": container with ID starting with 0800c74ee4b410b6a23cd0bb061a1ecd576ce36566cf47ad5d61712a930a59f7 not found: ID does not exist"
Sep 09 12:39:14.148937 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.148900    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"]
Sep 09 12:39:14.152706 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.152681    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bc0270-64b75f7488-dxl5v"]
Sep 09 12:39:14.400157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:14.400074    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c450cfb0-df51-4ae3-b8b2-3f0497b4f581" path="/var/lib/kubelet/pods/c450cfb0-df51-4ae3-b8b2-3f0497b4f581/volumes"
Sep 09 12:39:20.298863 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:20.298815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:20.433437 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:20.433396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:20.580325 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:20.580272    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"]
Sep 09 12:39:20.580586 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:20.580558    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy" containerID="cri-o://20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1" gracePeriod=30
Sep 09 12:39:20.602132 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:20.602101    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:25.829753 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.829724    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:39:25.923587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923485    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-podinfo\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.923587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923526    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-token\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.923587 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923558    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjl5j\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-kube-api-access-vjl5j\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.923877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923591    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-envoy\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.923877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923618    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-socket\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.923877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923657    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6526777-4f4a-4272-b54e-58b52b00fa11-istiod-ca-cert\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.923877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923702    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-credential-socket\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.923877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923727    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-certs\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.923877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.923749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-data\") pod \"e6526777-4f4a-4272-b54e-58b52b00fa11\" (UID: \"e6526777-4f4a-4272-b54e-58b52b00fa11\") "
Sep 09 12:39:25.924211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.924003    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:25.924211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.924010    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:25.924211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.924100    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:25.924211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.924123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6526777-4f4a-4272-b54e-58b52b00fa11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:39:25.924211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.924179    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:25.924211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.924198    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:25.924496 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.924225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:25.925802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.925774    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-kube-api-access-vjl5j" (OuterVolumeSpecName: "kube-api-access-vjl5j") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "kube-api-access-vjl5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:39:25.925919 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.925804    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:39:25.925919 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.925864    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:39:25.926148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:25.926134    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6526777-4f4a-4272-b54e-58b52b00fa11" (UID: "e6526777-4f4a-4272-b54e-58b52b00fa11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:39:26.025110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.025069    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:26.025110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.025102    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:26.025110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.025113    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:26.025110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.025121    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:26.025425 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.025130    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjl5j\" (UniqueName: \"kubernetes.io/projected/e6526777-4f4a-4272-b54e-58b52b00fa11-kube-api-access-vjl5j\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:26.025425 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.025139    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6526777-4f4a-4272-b54e-58b52b00fa11-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:26.025425 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.025147    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6526777-4f4a-4272-b54e-58b52b00fa11-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:39:26.206430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.206337    2560 generic.go:356] "Generic (PLEG): container finished" podID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerID="20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1" exitCode=0
Sep 09 12:39:26.206430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.206400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" event={"ID":"e6526777-4f4a-4272-b54e-58b52b00fa11","Type":"ContainerDied","Data":"20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1"}
Sep 09 12:39:26.206430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.206404    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"
Sep 09 12:39:26.206696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.206442    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4" event={"ID":"e6526777-4f4a-4272-b54e-58b52b00fa11","Type":"ContainerDied","Data":"0d4db47458502df83de9ea74da677e74a0fde64f180e2ef1ac138c61558326df"}
Sep 09 12:39:26.206696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.206464    2560 scope.go:117] "RemoveContainer" containerID="20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1"
Sep 09 12:39:26.217326 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.217288    2560 scope.go:117] "RemoveContainer" containerID="858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1"
Sep 09 12:39:26.227709 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.227687    2560 scope.go:117] "RemoveContainer" containerID="20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1"
Sep 09 12:39:26.227996 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:39:26.227977    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1\": container with ID starting with 20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1 not found: ID does not exist" containerID="20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1"
Sep 09 12:39:26.228045 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.228005    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1"} err="failed to get container status \"20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1\": rpc error: code = NotFound desc = could not find container \"20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1\": container with ID starting with 20bb5a32f93542b2490dfd6feea77a237d2d9ac717a703cfc304708b3be3a6c1 not found: ID does not exist"
Sep 09 12:39:26.228045 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.228022    2560 scope.go:117] "RemoveContainer" containerID="858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1"
Sep 09 12:39:26.228274 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:39:26.228257    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1\": container with ID starting with 858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1 not found: ID does not exist" containerID="858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1"
Sep 09 12:39:26.228344 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.228281    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1"} err="failed to get container status \"858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1\": rpc error: code = NotFound desc = could not find container \"858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1\": container with ID starting with 858f73530b303aba3b401275244230f1016086b56a330761b6c2eb3737785ff1 not found: ID does not exist"
Sep 09 12:39:26.232986 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.232964    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"]
Sep 09 12:39:26.236537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.236516    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bc0270-openshift-default-76867bdd48-wf9s4"]
Sep 09 12:39:26.400271 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.400228    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" path="/var/lib/kubelet/pods/e6526777-4f4a-4272-b54e-58b52b00fa11/volumes"
Sep 09 12:39:26.709158 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:26.709125    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:39:40.925735 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:40.925692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:41.026417 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:41.026369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:41.092052 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:41.092011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:44.740183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:44.740141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:47.221934 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:47.221847    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:39:48.214865 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:48.214824    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:39:53.260000 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:39:53.259946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:40:03.212376 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:03.212345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:40:17.715186 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:17.715151    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:40:21.091182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091139    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7884-41be19"]
Sep 09 12:40:21.091769 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091747    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091772    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091786    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091795    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091810    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e820cb-4523-4053-a758-e7bd409bde6d" containerName="maas-api"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091820    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e820cb-4523-4053-a758-e7bd409bde6d" containerName="maas-api"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091831    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c450cfb0-df51-4ae3-b8b2-3f0497b4f581" containerName="maas-api"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091840    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c450cfb0-df51-4ae3-b8b2-3f0497b4f581" containerName="maas-api"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091849    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy"
Sep 09 12:40:21.091855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091858    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091878    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c985635f-6a90-425e-80f8-6397c875f7a0" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091887    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c985635f-6a90-425e-80f8-6397c875f7a0" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091902    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e97add39-0d65-43f4-809d-03c21a059870" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091910    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e97add39-0d65-43f4-809d-03c21a059870" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091921    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091929    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091938    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34bc2342-6818-44a2-840a-c8a49cd4d2cb" containerName="main"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091946    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="34bc2342-6818-44a2-840a-c8a49cd4d2cb" containerName="main"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091967    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091975    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091987    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.091995    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092089    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092100    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092109    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c985635f-6a90-425e-80f8-6397c875f7a0" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092118    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092127    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da8c4f2-782d-4ff3-9cfc-e92d10e47930" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092135    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="34bc2342-6818-44a2-840a-c8a49cd4d2cb" containerName="main"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092144    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c450cfb0-df51-4ae3-b8b2-3f0497b4f581" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092152    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c41c14c-07cf-48b9-a0ef-efa50a4d2c64" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092159    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092168    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e97add39-0d65-43f4-809d-03c21a059870" containerName="maas-api"
Sep 09 12:40:21.092342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.092178    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e820cb-4523-4053-a758-e7bd409bde6d" containerName="maas-api"
Sep 09 12:40:21.095780 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.095759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7884-41be19"
Sep 09 12:40:21.098227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.098193    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kwwl8\""
Sep 09 12:40:21.100914 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.100889    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7884-41be19"]
Sep 09 12:40:21.242994 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.242950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkd7g\" (UniqueName: \"kubernetes.io/projected/eec38431-dfc5-4c15-b9e9-87cd0f9e8109-kube-api-access-jkd7g\") pod \"mt-curl-7884-41be19\" (UID: \"eec38431-dfc5-4c15-b9e9-87cd0f9e8109\") " pod="opendatahub/mt-curl-7884-41be19"
Sep 09 12:40:21.344176 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.344087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkd7g\" (UniqueName: \"kubernetes.io/projected/eec38431-dfc5-4c15-b9e9-87cd0f9e8109-kube-api-access-jkd7g\") pod \"mt-curl-7884-41be19\" (UID: \"eec38431-dfc5-4c15-b9e9-87cd0f9e8109\") " pod="opendatahub/mt-curl-7884-41be19"
Sep 09 12:40:21.353658 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.353629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkd7g\" (UniqueName: \"kubernetes.io/projected/eec38431-dfc5-4c15-b9e9-87cd0f9e8109-kube-api-access-jkd7g\") pod \"mt-curl-7884-41be19\" (UID: \"eec38431-dfc5-4c15-b9e9-87cd0f9e8109\") " pod="opendatahub/mt-curl-7884-41be19"
Sep 09 12:40:21.406891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.406853    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7884-41be19"
Sep 09 12:40:21.677449 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.677416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7884-41be19"]
Sep 09 12:40:21.679446 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:40:21.679417    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeec38431_dfc5_4c15_b9e9_87cd0f9e8109.slice/crio-7d437f5306fe4d453dddbd76707c3578f062bd8772210df2b1fccc49d85d6982 WatchSource:0}: Error finding container 7d437f5306fe4d453dddbd76707c3578f062bd8772210df2b1fccc49d85d6982: Status 404 returned error can't find the container with id 7d437f5306fe4d453dddbd76707c3578f062bd8772210df2b1fccc49d85d6982
Sep 09 12:40:21.680711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:21.680689    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 12:40:22.527463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:22.527426    2560 generic.go:356] "Generic (PLEG): container finished" podID="eec38431-dfc5-4c15-b9e9-87cd0f9e8109" containerID="00fc5c162d8012089dc089a473876b598e1e45e5f5ca0e1e3481905db8f2b993" exitCode=0
Sep 09 12:40:22.527856 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:22.527507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7884-41be19" event={"ID":"eec38431-dfc5-4c15-b9e9-87cd0f9e8109","Type":"ContainerDied","Data":"00fc5c162d8012089dc089a473876b598e1e45e5f5ca0e1e3481905db8f2b993"}
Sep 09 12:40:22.527856 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:22.527548    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7884-41be19" event={"ID":"eec38431-dfc5-4c15-b9e9-87cd0f9e8109","Type":"ContainerStarted","Data":"7d437f5306fe4d453dddbd76707c3578f062bd8772210df2b1fccc49d85d6982"}
Sep 09 12:40:23.669096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:23.669072    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7884-41be19"
Sep 09 12:40:23.692037 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:23.692000    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7884-41be19_eec38431-dfc5-4c15-b9e9-87cd0f9e8109/mt-curl-7884-41be19/0.log"
Sep 09 12:40:23.719883 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:23.719842    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7884-41be19"]
Sep 09 12:40:23.724463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:23.724432    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7884-41be19"]
Sep 09 12:40:23.767193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:23.767149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkd7g\" (UniqueName: \"kubernetes.io/projected/eec38431-dfc5-4c15-b9e9-87cd0f9e8109-kube-api-access-jkd7g\") pod \"eec38431-dfc5-4c15-b9e9-87cd0f9e8109\" (UID: \"eec38431-dfc5-4c15-b9e9-87cd0f9e8109\") "
Sep 09 12:40:23.769255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:23.769225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec38431-dfc5-4c15-b9e9-87cd0f9e8109-kube-api-access-jkd7g" (OuterVolumeSpecName: "kube-api-access-jkd7g") pod "eec38431-dfc5-4c15-b9e9-87cd0f9e8109" (UID: "eec38431-dfc5-4c15-b9e9-87cd0f9e8109"). InnerVolumeSpecName "kube-api-access-jkd7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:40:23.867992 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:23.867945    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkd7g\" (UniqueName: \"kubernetes.io/projected/eec38431-dfc5-4c15-b9e9-87cd0f9e8109-kube-api-access-jkd7g\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:40:24.399856 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:24.399822    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eec38431-dfc5-4c15-b9e9-87cd0f9e8109" path="/var/lib/kubelet/pods/eec38431-dfc5-4c15-b9e9-87cd0f9e8109/volumes"
Sep 09 12:40:24.541498 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:24.541467    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7884-41be19"
Sep 09 12:40:24.541694 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:24.541506    2560 scope.go:117] "RemoveContainer" containerID="00fc5c162d8012089dc089a473876b598e1e45e5f5ca0e1e3481905db8f2b993"
Sep 09 12:40:28.750491 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:28.750442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:40:29.992261 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:29.992229    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:40:30.713775 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:30.713742    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:40:32.194643 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.194608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"]
Sep 09 12:40:32.195177 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.195159    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy"
Sep 09 12:40:32.195230 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.195181    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af30259-4d85-4d75-9df1-248f4a1aee7d" containerName="istio-proxy"
Sep 09 12:40:32.195230 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.195199    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec38431-dfc5-4c15-b9e9-87cd0f9e8109" containerName="mt-curl-7884-41be19"
Sep 09 12:40:32.195230 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.195206    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec38431-dfc5-4c15-b9e9-87cd0f9e8109" containerName="mt-curl-7884-41be19"
Sep 09 12:40:32.195363 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.195267    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec38431-dfc5-4c15-b9e9-87cd0f9e8109" containerName="mt-curl-7884-41be19"
Sep 09 12:40:32.195363 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.195279    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6526777-4f4a-4272-b54e-58b52b00fa11" containerName="istio-proxy"
Sep 09 12:40:32.198372 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.198347    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.201780 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.201759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-679f45\"/\"default-dockercfg-skmbs\""
Sep 09 12:40:32.201910 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.201781    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-679f45\"/\"kube-root-ca.crt\""
Sep 09 12:40:32.201910 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.201801    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-679f45\"/\"openshift-service-ca.crt\""
Sep 09 12:40:32.201910 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.201781    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-679f45\"/\"rate-test-model-679f45-kserve-self-signed-certs\""
Sep 09 12:40:32.207112 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.207063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"]
Sep 09 12:40:32.220116 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.220082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:40:32.347573 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.347538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-dshm\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.347737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.347586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-home\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.347737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.347614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j672\" (UniqueName: \"kubernetes.io/projected/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-kube-api-access-5j672\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.347737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.347673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tmp-dir\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.347737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.347706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tls-certs\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.347737 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.347728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-model-cache\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.448997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tmp-dir\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.449032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tls-certs\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449080 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.449060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-model-cache\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449421 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.449158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-dshm\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449421 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.449211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-home\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449421 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.449251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j672\" (UniqueName: \"kubernetes.io/projected/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-kube-api-access-5j672\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.449526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-model-cache\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449637 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.449548    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tmp-dir\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.449708 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.449689    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-home\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.451392 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.451369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-dshm\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.451531 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.451514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tls-certs\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.460652 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.460626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j672\" (UniqueName: \"kubernetes.io/projected/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-kube-api-access-5j672\") pod \"rate-test-model-679f45-kserve-696f9cf5-786jz\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") " pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.510531 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.510493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:32.789539 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:32.789509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"]
Sep 09 12:40:32.791000 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:40:32.790961    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dfc308d_f8a3_4ebd_85d2_a1107e216b2e.slice/crio-7f6d1ee3fc65b83fb274d747a99c783d2fdcd12a365e8c8c8d8154a64a69b334 WatchSource:0}: Error finding container 7f6d1ee3fc65b83fb274d747a99c783d2fdcd12a365e8c8c8d8154a64a69b334: Status 404 returned error can't find the container with id 7f6d1ee3fc65b83fb274d747a99c783d2fdcd12a365e8c8c8d8154a64a69b334
Sep 09 12:40:33.591342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:33.591279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz" event={"ID":"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e","Type":"ContainerStarted","Data":"963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c"}
Sep 09 12:40:33.591342 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:33.591345    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz" event={"ID":"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e","Type":"ContainerStarted","Data":"7f6d1ee3fc65b83fb274d747a99c783d2fdcd12a365e8c8c8d8154a64a69b334"}
Sep 09 12:40:33.609403 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:33.609355    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz" podStartSLOduration=1.609340697 podStartE2EDuration="1.609340697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:40:33.608633269 +0000 UTC m=+1749.654758446" watchObservedRunningTime="2026-09-09 12:40:33.609340697 +0000 UTC m=+1749.655465879"
Sep 09 12:40:42.510693 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:42.510659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:42.511153 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:42.510713    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:42.523886 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:42.523861    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:42.610037 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:42.609996    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:40:42.649341 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:42.649311    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:40:58.060324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:40:58.060268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:01.615486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:01.615441    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:41:22.409541 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:22.409450    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:41:24.502677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:24.502645    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:41:24.515983 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:24.515958    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:41:37.215220 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:37.215180    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:41:44.183741 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:44.183708    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"]
Sep 09 12:41:44.208271 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:44.208237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:45.129193 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:45.129151    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:45.611710 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:45.611678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:45.904935 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:45.904844    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"]
Sep 09 12:41:45.908556 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:45.908531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:45.910950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:45.910926    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-232ce2-openshift-default-dockercfg-qr8fl\""
Sep 09 12:41:45.921932 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:45.921907    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"]
Sep 09 12:41:45.935759 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:45.935726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:46.035192 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.035135    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:46.036225 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-podinfo\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.036313 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-data\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.036357 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-certs\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.036400 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istiod-ca-cert\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.036436 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-credential-socket\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.036473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-token\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.036473 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-envoy\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.036552 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vw7c\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-kube-api-access-4vw7c\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.036595 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.036562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-socket\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138023 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.137981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-certs\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istiod-ca-cert\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-credential-socket\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-token\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-envoy\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vw7c\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-kube-api-access-4vw7c\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-socket\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138580 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-podinfo\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138580 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-data\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138580 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-certs\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138744 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-credential-socket\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-data\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138870 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138791    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-socket\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.138927 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.138889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istiod-ca-cert\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.140968 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.140945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-podinfo\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.141063 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.140947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-envoy\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.147769 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.147740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-token\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.147888 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.147842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vw7c\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-kube-api-access-4vw7c\") pod \"e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") " pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.220215 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.220132    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:46.505710 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.505676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"]
Sep 09 12:41:46.506974 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:41:46.506943    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6bcb6f_13ff_4d27_a215_9291670aba2b.slice/crio-9680515901d1e6945269ecb5c19a38da4884ecbd0d25f0519d0bd943578d0e71 WatchSource:0}: Error finding container 9680515901d1e6945269ecb5c19a38da4884ecbd0d25f0519d0bd943578d0e71: Status 404 returned error can't find the container with id 9680515901d1e6945269ecb5c19a38da4884ecbd0d25f0519d0bd943578d0e71
Sep 09 12:41:46.516223 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.509825    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:41:46.516223 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.509969    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:41:46.516223 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:46.510062    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:41:47.006621 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:47.006577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" event={"ID":"9c6bcb6f-13ff-4d27-a215-9291670aba2b","Type":"ContainerStarted","Data":"f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d"}
Sep 09 12:41:47.007031 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:47.006662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" event={"ID":"9c6bcb6f-13ff-4d27-a215-9291670aba2b","Type":"ContainerStarted","Data":"9680515901d1e6945269ecb5c19a38da4884ecbd0d25f0519d0bd943578d0e71"}
Sep 09 12:41:47.034617 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:47.034554    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" podStartSLOduration=2.03451909 podStartE2EDuration="2.03451909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:41:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:41:47.030985192 +0000 UTC m=+1823.077110370" watchObservedRunningTime="2026-09-09 12:41:47.03451909 +0000 UTC m=+1823.080644269"
Sep 09 12:41:47.221150 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:47.221110    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:47.226650 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:47.226625    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:47.811493 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:47.811457    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:41:48.012249 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:48.012217    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:48.013306 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:48.013273    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:41:49.108939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:49.108900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:49.205879 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:49.205847    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:50.407282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.407250    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"]
Sep 09 12:41:50.411022 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.410998    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.413633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.413611    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-232ce2-serving-cert\""
Sep 09 12:41:50.421706 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.421551    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"]
Sep 09 12:41:50.441732 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.441698    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:50.474828 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.474789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-metrics-certs\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.475012 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.474879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78gk8\" (UniqueName: \"kubernetes.io/projected/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-kube-api-access-78gk8\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.475012 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.474924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.475012 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.474949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.542033 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.541996    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:50.576228 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.576198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-metrics-certs\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.576389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.576239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78gk8\" (UniqueName: \"kubernetes.io/projected/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-kube-api-access-78gk8\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.576389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.576267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.576389 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.576288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.576506 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:41:50.576386    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-serving-cert: secret "maas-api-e2e-ipp-a-232ce2-serving-cert" not found
Sep 09 12:41:50.576506 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:41:50.576458    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls podName:c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d nodeName:}" failed. No retries permitted until 2026-09-09 12:41:51.076437971 +0000 UTC m=+1827.122563142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls") pod "maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf" (UID: "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d") : secret "maas-api-e2e-ipp-a-232ce2-serving-cert" not found
Sep 09 12:41:50.576941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.576913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.578654 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.578634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-metrics-certs\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.585025 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.585002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78gk8\" (UniqueName: \"kubernetes.io/projected/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-kube-api-access-78gk8\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:50.860035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.859983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:50.957094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:50.957047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:51.052366 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:51.052328    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:41:51.081641 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:51.081578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:51.084120 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:51.084088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls\") pod \"maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:51.326820 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:51.326790    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:51.606314 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:51.606270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"]
Sep 09 12:41:51.607795 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:41:51.607767    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9cb1436_d1d1_4e8b_8cd9_dd9828e8414d.slice/crio-492a19fb9b1831dc4420b35eb101d9e06c3f1e0ae41d830596b10c655cf4aa6f WatchSource:0}: Error finding container 492a19fb9b1831dc4420b35eb101d9e06c3f1e0ae41d830596b10c655cf4aa6f: Status 404 returned error can't find the container with id 492a19fb9b1831dc4420b35eb101d9e06c3f1e0ae41d830596b10c655cf4aa6f
Sep 09 12:41:52.037105 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:52.037074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf" event={"ID":"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d","Type":"ContainerStarted","Data":"492a19fb9b1831dc4420b35eb101d9e06c3f1e0ae41d830596b10c655cf4aa6f"}
Sep 09 12:41:53.045176 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:53.045140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf" event={"ID":"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d","Type":"ContainerStarted","Data":"11fdd6ec69019060acc76171988ac442521a179b40d1d4113cf8a91ec32413da"}
Sep 09 12:41:53.045682 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:53.045211    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:53.066996 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:53.066948    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf" podStartSLOduration=2.64056638 podStartE2EDuration="3.066932098s" totalImagesPullingTime="426.365718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:41:53.063228188 +0000 UTC m=+1829.109353366" watchObservedRunningTime="2026-09-09 12:41:53.066932098 +0000 UTC m=+1829.113057302"
Sep 09 12:41:59.061646 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.061611    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:41:59.203188 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.203139    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz" podUID="4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" containerName="main" containerID="cri-o://963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c" gracePeriod=45
Sep 09 12:41:59.488678 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.488654    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:41:59.515580 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.515547    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:41:59.674766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.674674    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tmp-dir\") pod \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") "
Sep 09 12:41:59.674766 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.674736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tls-certs\") pod \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") "
Sep 09 12:41:59.674960 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.674807    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j672\" (UniqueName: \"kubernetes.io/projected/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-kube-api-access-5j672\") pod \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") "
Sep 09 12:41:59.674960 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.674837    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-dshm\") pod \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") "
Sep 09 12:41:59.674960 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.674872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-home\") pod \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") "
Sep 09 12:41:59.675103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.674959    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-model-cache\") pod \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\" (UID: \"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e\") "
Sep 09 12:41:59.675103 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.674974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" (UID: "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:41:59.675238 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.675204    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-home" (OuterVolumeSpecName: "home") pod "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" (UID: "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:41:59.675323 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.675241    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-model-cache" (OuterVolumeSpecName: "model-cache") pod "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" (UID: "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:41:59.675404 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.675376    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-home\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:41:59.675404 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.675402    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-model-cache\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:41:59.675599 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.675418    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tmp-dir\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:41:59.676984 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.676955    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" (UID: "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:41:59.677205 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.677175    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-dshm" (OuterVolumeSpecName: "dshm") pod "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" (UID: "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:41:59.677286 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.677259    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-kube-api-access-5j672" (OuterVolumeSpecName: "kube-api-access-5j672") pod "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" (UID: "4dfc308d-f8a3-4ebd-85d2-a1107e216b2e"). InnerVolumeSpecName "kube-api-access-5j672". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:41:59.776929 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.776888    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-tls-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:41:59.776929 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.776923    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j672\" (UniqueName: \"kubernetes.io/projected/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-kube-api-access-5j672\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:41:59.776929 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:41:59.776932    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e-dshm\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:42:00.091518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.091483    2560 generic.go:356] "Generic (PLEG): container finished" podID="4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" containerID="963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c" exitCode=0
Sep 09 12:42:00.091972 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.091527    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"
Sep 09 12:42:00.091972 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.091549    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz" event={"ID":"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e","Type":"ContainerDied","Data":"963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c"}
Sep 09 12:42:00.091972 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.091584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz" event={"ID":"4dfc308d-f8a3-4ebd-85d2-a1107e216b2e","Type":"ContainerDied","Data":"7f6d1ee3fc65b83fb274d747a99c783d2fdcd12a365e8c8c8d8154a64a69b334"}
Sep 09 12:42:00.091972 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.091601    2560 scope.go:117] "RemoveContainer" containerID="963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c"
Sep 09 12:42:00.101324 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.101287    2560 scope.go:117] "RemoveContainer" containerID="963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c"
Sep 09 12:42:00.101653 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:42:00.101629    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c\": container with ID starting with 963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c not found: ID does not exist" containerID="963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c"
Sep 09 12:42:00.101711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.101660    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c"} err="failed to get container status \"963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c\": rpc error: code = NotFound desc = could not find container \"963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c\": container with ID starting with 963b96d4fd2adca90572434e5a50869156242014bd40f6e2ca34e0cfa23dc65c not found: ID does not exist"
Sep 09 12:42:00.115341 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.115308    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"]
Sep 09 12:42:00.121008 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.120981    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-679f45/rate-test-model-679f45-kserve-696f9cf5-786jz"]
Sep 09 12:42:00.402372 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:00.402338    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" path="/var/lib/kubelet/pods/4dfc308d-f8a3-4ebd-85d2-a1107e216b2e/volumes"
Sep 09 12:42:03.430276 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:03.430132    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": read tcp 10.134.0.2:52974->10.134.0.82:15021: read: connection reset by peer" start-of-body=
Sep 09 12:42:03.430276 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:03.430206    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": read tcp 10.134.0.2:52974->10.134.0.82:15021: read: connection reset by peer"
Sep 09 12:42:04.120693 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:04.120657    2560 generic.go:356] "Generic (PLEG): container finished" podID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerID="f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d" exitCode=0
Sep 09 12:42:04.120885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:04.120726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" event={"ID":"9c6bcb6f-13ff-4d27-a215-9291670aba2b","Type":"ContainerDied","Data":"f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d"}
Sep 09 12:42:04.121139 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:04.121125    2560 scope.go:117] "RemoveContainer" containerID="f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d"
Sep 09 12:42:04.122200 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:04.122170    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:42:04.122264 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:04.122242    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:42:04.122314 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:04.122272    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:42:05.128885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:05.128852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" event={"ID":"9c6bcb6f-13ff-4d27-a215-9291670aba2b","Type":"ContainerStarted","Data":"fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573"}
Sep 09 12:42:05.220474 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:05.220435    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:42:05.220696 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:05.220668    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 09 12:42:05.220812 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:05.220717    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 09 12:42:06.220783 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:06.220750    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 09 12:42:06.221255 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:06.220810    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 09 12:42:07.220589 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:07.220552    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 09 12:42:07.220775 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:07.220622    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 09 12:42:08.220853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:08.220816    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 09 12:42:08.221276 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:08.220883    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 09 12:42:09.220622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:09.220586    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 09 12:42:09.220808 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:09.220643    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 09 12:42:10.223802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:10.223771    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:42:10.224249 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:10.224230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:42:10.225009 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:10.224989    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:42:14.102573 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:14.102532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:15.740109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:15.740068    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:17.382817 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:17.382778    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:18.280169 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:18.280130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:18.424284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:18.424248    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:19.489926 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.489893    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"]
Sep 09 12:42:19.490538 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.490516    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" containerName="main"
Sep 09 12:42:19.490538 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.490539    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" containerName="main"
Sep 09 12:42:19.490692 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.490654    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dfc308d-f8a3-4ebd-85d2-a1107e216b2e" containerName="main"
Sep 09 12:42:19.496471 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.496110    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.501863 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.501831    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-8ec58b-serving-cert\""
Sep 09 12:42:19.508159 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.508126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"]
Sep 09 12:42:19.528344 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.528281    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:19.555479 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.555438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qq9\" (UniqueName: \"kubernetes.io/projected/011e983e-9b72-4269-88a2-8a822d6a93e9-kube-api-access-p9qq9\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.555479 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.555481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/011e983e-9b72-4269-88a2-8a822d6a93e9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.555695 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.555557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-metrics-certs\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.555695 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.555610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.628025 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.627991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:19.656111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.656077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qq9\" (UniqueName: \"kubernetes.io/projected/011e983e-9b72-4269-88a2-8a822d6a93e9-kube-api-access-p9qq9\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.656111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.656117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/011e983e-9b72-4269-88a2-8a822d6a93e9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.656408 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.656174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-metrics-certs\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.656408 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.656196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.656408 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:42:19.656331    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-serving-cert: secret "maas-api-e2e-ipp-b-8ec58b-serving-cert" not found
Sep 09 12:42:19.656408 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:42:19.656402    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls podName:011e983e-9b72-4269-88a2-8a822d6a93e9 nodeName:}" failed. No retries permitted until 2026-09-09 12:42:20.156383975 +0000 UTC m=+1856.202509131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls") pod "maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg" (UID: "011e983e-9b72-4269-88a2-8a822d6a93e9") : secret "maas-api-e2e-ipp-b-8ec58b-serving-cert" not found
Sep 09 12:42:19.656981 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.656955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/011e983e-9b72-4269-88a2-8a822d6a93e9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.658639 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.658614    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-metrics-certs\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:19.667916 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:19.667891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qq9\" (UniqueName: \"kubernetes.io/projected/011e983e-9b72-4269-88a2-8a822d6a93e9-kube-api-access-p9qq9\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:20.027384 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:20.027349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:20.126884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:20.126849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:20.161209 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:20.161174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:20.164054 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:20.164029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:20.209893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:20.209853    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:20.416066 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:20.416028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:20.690262 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:20.690234    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"]
Sep 09 12:42:20.691903 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:42:20.691871    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011e983e_9b72_4269_88a2_8a822d6a93e9.slice/crio-b713fd0478fc985934dc5c30eccc276295d0346ea70fc2c7a4da5670729a0b0d WatchSource:0}: Error finding container b713fd0478fc985934dc5c30eccc276295d0346ea70fc2c7a4da5670729a0b0d: Status 404 returned error can't find the container with id b713fd0478fc985934dc5c30eccc276295d0346ea70fc2c7a4da5670729a0b0d
Sep 09 12:42:21.233127 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:21.233091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg" event={"ID":"011e983e-9b72-4269-88a2-8a822d6a93e9","Type":"ContainerStarted","Data":"cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041"}
Sep 09 12:42:21.233329 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:21.233148    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg" event={"ID":"011e983e-9b72-4269-88a2-8a822d6a93e9","Type":"ContainerStarted","Data":"b713fd0478fc985934dc5c30eccc276295d0346ea70fc2c7a4da5670729a0b0d"}
Sep 09 12:42:21.233329 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:21.233256    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:21.251098 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:21.251047    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg" podStartSLOduration=1.824294191 podStartE2EDuration="2.251027439s" totalImagesPullingTime="426.733248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:42:21.250641926 +0000 UTC m=+1857.296767106" watchObservedRunningTime="2026-09-09 12:42:21.251027439 +0000 UTC m=+1857.297152608"
Sep 09 12:42:25.721000 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:25.720964    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:42:27.245970 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:27.245933    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:42:28.657226 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:28.657187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:40.622661 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:40.622618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:43.314970 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:43.314933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:52.732431 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:52.732343    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:53.553240 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:53.553204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:42:56.834077 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:56.834042    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:42:57.404502 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:42:57.404466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:12.530359 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:12.530323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:12.724718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:12.724678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:13.308607 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:13.308574    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:43:20.187087 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.187042    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:20.517773 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.517693    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"]
Sep 09 12:43:20.521684 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.521662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.524878 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.524855    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-330769-openshift-default-dockercfg-wsbss\""
Sep 09 12:43:20.535270 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.535240    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"]
Sep 09 12:43:20.552345 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.552311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:20.634057 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-envoy\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.634057 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.634338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634087    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-podinfo\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.634338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhh7d\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-kube-api-access-xhh7d\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.634338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-token\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.634338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-socket\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.634338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-certs\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.634605 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-credential-socket\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.634605 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.634461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-data\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.735656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-credential-socket\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.735656 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-data\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.735897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-envoy\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.735897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.735897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-podinfo\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.735897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhh7d\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-kube-api-access-xhh7d\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.735897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-token\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.736170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-socket\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.736170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.735999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-certs\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.736170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.736087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-credential-socket\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.736170 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.736124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-data\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.736407 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.736284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-socket\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.736407 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.736362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-certs\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.736760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.736735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.738318 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.738258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-envoy\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.738447 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.738392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-podinfo\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.745844 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.745823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-token\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.746041 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.746015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhh7d\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-kube-api-access-xhh7d\") pod \"e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") " pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:20.831527 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:20.831490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:21.021582 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.021549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:21.111408 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.111382    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"]
Sep 09 12:43:21.112553 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:43:21.112524    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3b1ea9_8c14_44fd_908c_9d09c429c9c8.slice/crio-65949b88214a9654388eb1d0841bd99793fa4008bfa3dc487035d80923f6a443 WatchSource:0}: Error finding container 65949b88214a9654388eb1d0841bd99793fa4008bfa3dc487035d80923f6a443: Status 404 returned error can't find the container with id 65949b88214a9654388eb1d0841bd99793fa4008bfa3dc487035d80923f6a443
Sep 09 12:43:21.114838 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.114807    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:43:21.114902 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.114870    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:43:21.114902 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.114896    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:43:21.579624 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.579593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" event={"ID":"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8","Type":"ContainerStarted","Data":"a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c"}
Sep 09 12:43:21.580019 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.579656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" event={"ID":"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8","Type":"ContainerStarted","Data":"65949b88214a9654388eb1d0841bd99793fa4008bfa3dc487035d80923f6a443"}
Sep 09 12:43:21.602194 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.602144    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podStartSLOduration=1.602128481 podStartE2EDuration="1.602128481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:43:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:43:21.600491493 +0000 UTC m=+1917.646616671" watchObservedRunningTime="2026-09-09 12:43:21.602128481 +0000 UTC m=+1917.648253652"
Sep 09 12:43:21.831814 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:21.831738    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:22.838035 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:22.837999    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:23.557735 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:23.557684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:23.591229 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:23.591198    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:23.592098 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:23.592075    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:23.660816 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:23.660771    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:24.813194 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.813153    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"]
Sep 09 12:43:24.816900 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.816879    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.819424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.819399    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-330769-serving-cert\""
Sep 09 12:43:24.830215 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.830191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"]
Sep 09 12:43:24.857875 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.857843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:24.874119 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.874082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.874257 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.874121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6fks\" (UniqueName: \"kubernetes.io/projected/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-kube-api-access-q6fks\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.874362 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.874253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.874430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.874362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.941921 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.941879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:24.975107 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.975065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.975281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.975118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6fks\" (UniqueName: \"kubernetes.io/projected/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-kube-api-access-q6fks\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.975281 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.975228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.975427 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.975332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.975512 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:43:24.975489    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-serving-cert: secret "maas-api-e2e-ipp-cleanup-330769-serving-cert" not found
Sep 09 12:43:24.975583 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:43:24.975573    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls podName:1417eeca-cb52-43de-8dd2-a7a7b3ff60c6 nodeName:}" failed. No retries permitted until 2026-09-09 12:43:25.475551457 +0000 UTC m=+1921.521676626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p" (UID: "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6") : secret "maas-api-e2e-ipp-cleanup-330769-serving-cert" not found
Sep 09 12:43:24.975941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.975922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:24.977602 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:24.977581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:25.003350 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:25.003322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6fks\" (UniqueName: \"kubernetes.io/projected/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-kube-api-access-q6fks\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:25.402396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:25.402366    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:25.479944 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:25.479912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:25.482203 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:25.482174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:25.497823 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:25.497797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:25.729325 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:25.729231    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:26.011264 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:26.011236    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"]
Sep 09 12:43:26.012653 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:43:26.012627    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1417eeca_cb52_43de_8dd2_a7a7b3ff60c6.slice/crio-5d6a555296951cfc8f7e23be51a863a2912c5e611de78c5cee4f1658ec352b1e WatchSource:0}: Error finding container 5d6a555296951cfc8f7e23be51a863a2912c5e611de78c5cee4f1658ec352b1e: Status 404 returned error can't find the container with id 5d6a555296951cfc8f7e23be51a863a2912c5e611de78c5cee4f1658ec352b1e
Sep 09 12:43:26.609466 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:26.609424    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p" event={"ID":"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6","Type":"ContainerStarted","Data":"1a06d34705adce38b972fb06ce77f6caf15fa86f814ef8e47a7fbe276f28df8d"}
Sep 09 12:43:26.609659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:26.609484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p" event={"ID":"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6","Type":"ContainerStarted","Data":"5d6a555296951cfc8f7e23be51a863a2912c5e611de78c5cee4f1658ec352b1e"}
Sep 09 12:43:26.609659 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:26.609512    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:26.638902 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:26.638852    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p" podStartSLOduration=2.205388968 podStartE2EDuration="2.638837358s" totalImagesPullingTime="433.44839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:43:26.636072309 +0000 UTC m=+1922.682197487" watchObservedRunningTime="2026-09-09 12:43:26.638837358 +0000 UTC m=+1922.684962566"
Sep 09 12:43:32.620142 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:32.620113    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:32.723374 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:32.723335    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:43:43.717223 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:43.717185    2560 generic.go:356] "Generic (PLEG): container finished" podID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerID="a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c" exitCode=0
Sep 09 12:43:43.717677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:43.717261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" event={"ID":"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8","Type":"ContainerDied","Data":"a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c"}
Sep 09 12:43:43.717736 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:43.717720    2560 scope.go:117] "RemoveContainer" containerID="a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c"
Sep 09 12:43:43.718920 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:43.718889    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:43:43.718998 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:43.718986    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:43:43.719036 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:43.719020    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 12:43:44.725568 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:44.725533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" event={"ID":"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8","Type":"ContainerStarted","Data":"93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81"}
Sep 09 12:43:44.832287 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:44.832252    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:44.832544 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:44.832517    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 09 12:43:44.832632 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:44.832576    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 09 12:43:45.832630 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:45.832595    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 09 12:43:45.833023 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:45.832661    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 09 12:43:46.832200 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:46.832157    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 09 12:43:46.832396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:46.832217    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 09 12:43:47.832159 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:47.832112    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 09 12:43:47.832584 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:47.832192    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 09 12:43:48.633278 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:48.633244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:48.832012 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:48.831976    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 09 12:43:48.832192 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:48.832040    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 09 12:43:49.832694 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:49.832646    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Sep 09 12:43:49.833217 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:49.832705    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Sep 09 12:43:50.836443 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:50.836408    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:50.836875 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:50.836697    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:50.837486 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:50.837465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:43:55.560040 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.559998    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"]
Sep 09 12:43:55.560669 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.560306    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p" podUID="1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" containerName="maas-api" containerID="cri-o://1a06d34705adce38b972fb06ce77f6caf15fa86f814ef8e47a7fbe276f28df8d" gracePeriod=30
Sep 09 12:43:55.611154 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.611120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:55.726787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.726744    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:55.802970 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.802943    2560 generic.go:356] "Generic (PLEG): container finished" podID="1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" containerID="1a06d34705adce38b972fb06ce77f6caf15fa86f814ef8e47a7fbe276f28df8d" exitCode=0
Sep 09 12:43:55.803081 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.803019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p" event={"ID":"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6","Type":"ContainerDied","Data":"1a06d34705adce38b972fb06ce77f6caf15fa86f814ef8e47a7fbe276f28df8d"}
Sep 09 12:43:55.803133 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.803085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p" event={"ID":"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6","Type":"ContainerDied","Data":"5d6a555296951cfc8f7e23be51a863a2912c5e611de78c5cee4f1658ec352b1e"}
Sep 09 12:43:55.803133 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.803109    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d6a555296951cfc8f7e23be51a863a2912c5e611de78c5cee4f1658ec352b1e"
Sep 09 12:43:55.820303 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.820226    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:55.826064 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.826035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:55.920153 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.920121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:55.972397 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.972364    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls\") pod \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") "
Sep 09 12:43:55.972397 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.972401    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-metrics-certs\") pod \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") "
Sep 09 12:43:55.972622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.972464    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-openshift-service-ca\") pod \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") "
Sep 09 12:43:55.972622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.972554    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6fks\" (UniqueName: \"kubernetes.io/projected/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-kube-api-access-q6fks\") pod \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\" (UID: \"1417eeca-cb52-43de-8dd2-a7a7b3ff60c6\") "
Sep 09 12:43:55.972931 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.972899    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" (UID: "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:43:55.974775 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.974744    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" (UID: "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:43:55.974870 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.974774    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" (UID: "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:43:55.975060 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:55.975036    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-kube-api-access-q6fks" (OuterVolumeSpecName: "kube-api-access-q6fks") pod "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" (UID: "1417eeca-cb52-43de-8dd2-a7a7b3ff60c6"). InnerVolumeSpecName "kube-api-access-q6fks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:43:56.074182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:56.074092    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6fks\" (UniqueName: \"kubernetes.io/projected/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-kube-api-access-q6fks\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:43:56.074182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:56.074122    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:43:56.074182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:56.074132    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:43:56.074182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:56.074140    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:43:56.344805 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:56.344704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:43:56.808633 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:56.808607    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"
Sep 09 12:43:56.832802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:56.832764    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"]
Sep 09 12:43:56.844754 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:56.844723    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-330769-6645979876-5rf6p"]
Sep 09 12:43:58.400634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:43:58.400600    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" path="/var/lib/kubelet/pods/1417eeca-cb52-43de-8dd2-a7a7b3ff60c6/volumes"
Sep 09 12:44:00.030453 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:00.030422    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:44:03.928138 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:03.928104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:04.043282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:04.043238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:04.240468 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:04.240392    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"]
Sep 09 12:44:04.240629 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:04.240603    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy" containerID="cri-o://93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81" gracePeriod=30
Sep 09 12:44:04.259135 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:04.259105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:05.839175 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:05.839132    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 12:44:05.839571 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:05.839203    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 12:44:08.541903 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:08.541864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:09.498099 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.498067    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:44:09.601885 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.601853    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-podinfo\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.601896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-token\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.601934    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-certs\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.601989    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-socket\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602023    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhh7d\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-kube-api-access-xhh7d\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602060    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-envoy\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602169    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-data\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602219    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istiod-ca-cert\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602265    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-credential-socket\") pod \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\" (UID: \"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8\") "
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602322    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:44:09.602388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:44:09.603027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602541    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:44:09.603027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602670    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.603027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602674    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:44:09.603027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602689    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.603027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602702    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.603027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.602786    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:44:09.604135 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.604112    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:44:09.604135 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.604117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:44:09.604316 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.604280    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:44:09.604371 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.604318    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-kube-api-access-xhh7d" (OuterVolumeSpecName: "kube-api-access-xhh7d") pod "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" (UID: "ba3b1ea9-8c14-44fd-908c-9d09c429c9c8"). InnerVolumeSpecName "kube-api-access-xhh7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:44:09.703939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.703907    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.703939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.703933    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.703939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.703944    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.704142 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.703953    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.704142 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.703961    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhh7d\" (UniqueName: \"kubernetes.io/projected/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-kube-api-access-xhh7d\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.704142 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.703970    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:09.885339 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.885218    2560 generic.go:356] "Generic (PLEG): container finished" podID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerID="93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81" exitCode=0
Sep 09 12:44:09.885339 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.885263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" event={"ID":"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8","Type":"ContainerDied","Data":"93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81"}
Sep 09 12:44:09.885339 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.885267    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"
Sep 09 12:44:09.885592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.885340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6" event={"ID":"ba3b1ea9-8c14-44fd-908c-9d09c429c9c8","Type":"ContainerDied","Data":"65949b88214a9654388eb1d0841bd99793fa4008bfa3dc487035d80923f6a443"}
Sep 09 12:44:09.885592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.885361    2560 scope.go:117] "RemoveContainer" containerID="93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81"
Sep 09 12:44:09.895825 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.895810    2560 scope.go:117] "RemoveContainer" containerID="a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c"
Sep 09 12:44:09.907044 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.907029    2560 scope.go:117] "RemoveContainer" containerID="93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81"
Sep 09 12:44:09.907332 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:44:09.907311    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81\": container with ID starting with 93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81 not found: ID does not exist" containerID="93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81"
Sep 09 12:44:09.907401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.907340    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81"} err="failed to get container status \"93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81\": rpc error: code = NotFound desc = could not find container \"93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81\": container with ID starting with 93b9b3be6d9181aa4f7511d69f8cf438e6c97ca1a033f761720dbc9524d27f81 not found: ID does not exist"
Sep 09 12:44:09.907401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.907362    2560 scope.go:117] "RemoveContainer" containerID="a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c"
Sep 09 12:44:09.907620 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:44:09.907598    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c\": container with ID starting with a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c not found: ID does not exist" containerID="a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c"
Sep 09 12:44:09.907662 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.907629    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c"} err="failed to get container status \"a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c\": rpc error: code = NotFound desc = could not find container \"a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c\": container with ID starting with a5111e9fcaa94c7de4bf8b22cf41beeacf5f5ef628fe7a546df7f433d6b8501c not found: ID does not exist"
Sep 09 12:44:09.917491 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.917463    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"]
Sep 09 12:44:09.935597 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:09.935573    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-330769-openshift-default-bf765f5b8-g77f6"]
Sep 09 12:44:10.401725 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:10.401688    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" path="/var/lib/kubelet/pods/ba3b1ea9-8c14-44fd-908c-9d09c429c9c8/volumes"
Sep 09 12:44:21.417014 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:21.416935    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:44:23.808033 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:23.807997    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"]
Sep 09 12:44:23.808509 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:23.808276    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf" podUID="c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" containerName="maas-api" containerID="cri-o://11fdd6ec69019060acc76171988ac442521a179b40d1d4113cf8a91ec32413da" gracePeriod=30
Sep 09 12:44:23.839235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:23.839200    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:23.928147 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:23.928117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:23.967999 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:23.967963    2560 generic.go:356] "Generic (PLEG): container finished" podID="c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" containerID="11fdd6ec69019060acc76171988ac442521a179b40d1d4113cf8a91ec32413da" exitCode=0
Sep 09 12:44:23.968185 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:23.968041    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf" event={"ID":"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d","Type":"ContainerDied","Data":"11fdd6ec69019060acc76171988ac442521a179b40d1d4113cf8a91ec32413da"}
Sep 09 12:44:24.010242 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.010186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:24.080263 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.080237    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:44:24.114940 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.114904    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:24.140353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.140262    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78gk8\" (UniqueName: \"kubernetes.io/projected/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-kube-api-access-78gk8\") pod \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") "
Sep 09 12:44:24.140592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.140451    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-metrics-certs\") pod \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") "
Sep 09 12:44:24.140592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.140494    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls\") pod \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") "
Sep 09 12:44:24.140592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.140520    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-openshift-service-ca\") pod \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\" (UID: \"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d\") "
Sep 09 12:44:24.140984 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.140952    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" (UID: "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:44:24.143183 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.143145    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-kube-api-access-78gk8" (OuterVolumeSpecName: "kube-api-access-78gk8") pod "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" (UID: "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d"). InnerVolumeSpecName "kube-api-access-78gk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:44:24.143322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.143179    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" (UID: "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:44:24.143322 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.143240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" (UID: "c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:44:24.219004 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.218967    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:24.242579 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.242540    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:24.242579 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.242576    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:24.242796 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.242590    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:24.242796 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.242605    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78gk8\" (UniqueName: \"kubernetes.io/projected/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d-kube-api-access-78gk8\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:44:24.533557 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.533523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:24.974434 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.974404    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"
Sep 09 12:44:24.974891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.974438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf" event={"ID":"c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d","Type":"ContainerDied","Data":"492a19fb9b1831dc4420b35eb101d9e06c3f1e0ae41d830596b10c655cf4aa6f"}
Sep 09 12:44:24.974891 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.974496    2560 scope.go:117] "RemoveContainer" containerID="11fdd6ec69019060acc76171988ac442521a179b40d1d4113cf8a91ec32413da"
Sep 09 12:44:24.994713 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:24.994690    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"]
Sep 09 12:44:25.000251 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:25.000232    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf"]
Sep 09 12:44:26.399462 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:26.399432    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" path="/var/lib/kubelet/pods/c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d/volumes"
Sep 09 12:44:27.052178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:27.052133    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-232ce2-787749fcf6-td4vf" podUID="c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.83:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 09 12:44:29.602611 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:29.602567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:34.910379 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:34.910345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:44:49.584520 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:49.584478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:44:52.148619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:44:52.148583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:05.765806 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:05.765770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:07.570710 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:07.570664    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:13.674657 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:13.674619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:13.738096 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:13.738066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:13.943843 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:13.943764    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"]
Sep 09 12:45:13.944043 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:13.944016    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy" containerID="cri-o://fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573" gracePeriod=30
Sep 09 12:45:13.960557 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:13.960528    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:14.472693 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:14.472653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:19.196623 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.196599    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:45:19.294471 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.294367    2560 generic.go:356] "Generic (PLEG): container finished" podID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerID="fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573" exitCode=0
Sep 09 12:45:19.294471 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.294422    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"
Sep 09 12:45:19.294471 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.294453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" event={"ID":"9c6bcb6f-13ff-4d27-a215-9291670aba2b","Type":"ContainerDied","Data":"fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573"}
Sep 09 12:45:19.294711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.294511    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr" event={"ID":"9c6bcb6f-13ff-4d27-a215-9291670aba2b","Type":"ContainerDied","Data":"9680515901d1e6945269ecb5c19a38da4884ecbd0d25f0519d0bd943578d0e71"}
Sep 09 12:45:19.294711 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.294535    2560 scope.go:117] "RemoveContainer" containerID="fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573"
Sep 09 12:45:19.303608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.303597    2560 scope.go:117] "RemoveContainer" containerID="f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d"
Sep 09 12:45:19.311601 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.311571    2560 scope.go:117] "RemoveContainer" containerID="fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573"
Sep 09 12:45:19.311881 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:45:19.311862    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573\": container with ID starting with fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573 not found: ID does not exist" containerID="fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573"
Sep 09 12:45:19.311939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.311893    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573"} err="failed to get container status \"fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573\": rpc error: code = NotFound desc = could not find container \"fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573\": container with ID starting with fb408c05c88bf1a562687b686d24d92b6cefcfb2d42f7766d87a20e8e1329573 not found: ID does not exist"
Sep 09 12:45:19.311939 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.311913    2560 scope.go:117] "RemoveContainer" containerID="f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d"
Sep 09 12:45:19.312173 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:45:19.312157    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d\": container with ID starting with f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d not found: ID does not exist" containerID="f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d"
Sep 09 12:45:19.312227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.312178    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d"} err="failed to get container status \"f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d\": rpc error: code = NotFound desc = could not find container \"f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d\": container with ID starting with f6794994ceed594abbd32701a11706375e078fe56f586be93a57c6482ffbb50d not found: ID does not exist"
Sep 09 12:45:19.362028 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362002    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-data\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362190 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362040    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vw7c\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-kube-api-access-4vw7c\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362190 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362070    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-token\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362190 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362089    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-socket\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-certs\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362241    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-credential-socket\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362286    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:45:19.362396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362323    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-envoy\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362362    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-podinfo\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362323    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:45:19.362713 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362408    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istiod-ca-cert\") pod \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\" (UID: \"9c6bcb6f-13ff-4d27-a215-9291670aba2b\") "
Sep 09 12:45:19.362713 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362508    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:45:19.362713 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:45:19.362938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362825    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-data\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.362938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362848    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.362938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362862    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-workload-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.362938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362875    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-credential-socket\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.362938 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.362903    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:45:19.364348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.364322    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-kube-api-access-4vw7c" (OuterVolumeSpecName: "kube-api-access-4vw7c") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "kube-api-access-4vw7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:45:19.364348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.364331    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:45:19.364661 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.364636    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 12:45:19.364661 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.364642    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c6bcb6f-13ff-4d27-a215-9291670aba2b" (UID: "9c6bcb6f-13ff-4d27-a215-9291670aba2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 12:45:19.463901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.463868    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vw7c\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-kube-api-access-4vw7c\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.463901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.463896    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-token\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.463901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.463905    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-envoy\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.464139 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.463913    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istio-podinfo\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.464139 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.463921    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c6bcb6f-13ff-4d27-a215-9291670aba2b-istiod-ca-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:19.619014 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.618979    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"]
Sep 09 12:45:19.625823 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:19.625799    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-232ce2-openshift-default-7dddbfb95b-ntqcr"]
Sep 09 12:45:20.400485 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:20.400452    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" path="/var/lib/kubelet/pods/9c6bcb6f-13ff-4d27-a215-9291670aba2b/volumes"
Sep 09 12:45:21.078185 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:21.078147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:21.178353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:21.178322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:25.003734 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.003694    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"]
Sep 09 12:45:25.004274 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.004037    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg" podUID="011e983e-9b72-4269-88a2-8a822d6a93e9" containerName="maas-api" containerID="cri-o://cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041" gracePeriod=30
Sep 09 12:45:25.035070 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.035035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:25.120066 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.120019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:25.190385 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.190274    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:25.264082 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.264054    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:45:25.276522 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.276485    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:25.331069 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.331029    2560 generic.go:356] "Generic (PLEG): container finished" podID="011e983e-9b72-4269-88a2-8a822d6a93e9" containerID="cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041" exitCode=0
Sep 09 12:45:25.331286 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.331078    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"
Sep 09 12:45:25.331286 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.331090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg" event={"ID":"011e983e-9b72-4269-88a2-8a822d6a93e9","Type":"ContainerDied","Data":"cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041"}
Sep 09 12:45:25.331286 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.331138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg" event={"ID":"011e983e-9b72-4269-88a2-8a822d6a93e9","Type":"ContainerDied","Data":"b713fd0478fc985934dc5c30eccc276295d0346ea70fc2c7a4da5670729a0b0d"}
Sep 09 12:45:25.331286 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.331163    2560 scope.go:117] "RemoveContainer" containerID="cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041"
Sep 09 12:45:25.340481 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.340414    2560 scope.go:117] "RemoveContainer" containerID="cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041"
Sep 09 12:45:25.340782 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:45:25.340760    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041\": container with ID starting with cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041 not found: ID does not exist" containerID="cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041"
Sep 09 12:45:25.340860 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.340794    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041"} err="failed to get container status \"cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041\": rpc error: code = NotFound desc = could not find container \"cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041\": container with ID starting with cf1168aedb8f00fce553b5fab0411e884f75b3ab138815b250a42aae92412041 not found: ID does not exist"
Sep 09 12:45:25.345606 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.345576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:25.418349 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.418288    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/011e983e-9b72-4269-88a2-8a822d6a93e9-openshift-service-ca\") pod \"011e983e-9b72-4269-88a2-8a822d6a93e9\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") "
Sep 09 12:45:25.418549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.418393    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9qq9\" (UniqueName: \"kubernetes.io/projected/011e983e-9b72-4269-88a2-8a822d6a93e9-kube-api-access-p9qq9\") pod \"011e983e-9b72-4269-88a2-8a822d6a93e9\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") "
Sep 09 12:45:25.418549 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.418456    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-metrics-certs\") pod \"011e983e-9b72-4269-88a2-8a822d6a93e9\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") "
Sep 09 12:45:25.418670 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.418634    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls\") pod \"011e983e-9b72-4269-88a2-8a822d6a93e9\" (UID: \"011e983e-9b72-4269-88a2-8a822d6a93e9\") "
Sep 09 12:45:25.418769 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.418748    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011e983e-9b72-4269-88a2-8a822d6a93e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "011e983e-9b72-4269-88a2-8a822d6a93e9" (UID: "011e983e-9b72-4269-88a2-8a822d6a93e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:45:25.419100 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.419071    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/011e983e-9b72-4269-88a2-8a822d6a93e9-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:25.421151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.421126    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "011e983e-9b72-4269-88a2-8a822d6a93e9" (UID: "011e983e-9b72-4269-88a2-8a822d6a93e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:45:25.421151 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.421143    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011e983e-9b72-4269-88a2-8a822d6a93e9-kube-api-access-p9qq9" (OuterVolumeSpecName: "kube-api-access-p9qq9") pod "011e983e-9b72-4269-88a2-8a822d6a93e9" (UID: "011e983e-9b72-4269-88a2-8a822d6a93e9"). InnerVolumeSpecName "kube-api-access-p9qq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:45:25.421400 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.421375    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "011e983e-9b72-4269-88a2-8a822d6a93e9" (UID: "011e983e-9b72-4269-88a2-8a822d6a93e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:45:25.520693 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.520588    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:25.520693 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.520623    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9qq9\" (UniqueName: \"kubernetes.io/projected/011e983e-9b72-4269-88a2-8a822d6a93e9-kube-api-access-p9qq9\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:25.520693 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.520640    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/011e983e-9b72-4269-88a2-8a822d6a93e9-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:25.657848 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.657814    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"]
Sep 09 12:45:25.676393 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.676363    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ec58b-59b49c4c75-fs7mg"]
Sep 09 12:45:25.749115 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:25.749074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:26.399873 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:26.399839    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011e983e-9b72-4269-88a2-8a822d6a93e9" path="/var/lib/kubelet/pods/011e983e-9b72-4269-88a2-8a822d6a93e9/volumes"
Sep 09 12:45:28.420327 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:28.420279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:45:32.106178 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:32.106141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:32.183544 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:32.183508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:32.444886 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:32.444793    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:32.848208 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:32.848165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:43.202239 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.202196    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"]
Sep 09 12:45:43.202853 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.202476    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp" podUID="2c19a81b-7181-46c3-951d-1b98913cc332" containerName="maas-api" containerID="cri-o://158921a68d5014279eabbdf3dc298901a3b4f7f1b296236a6c86b6415c24a00f" gracePeriod=30
Sep 09 12:45:43.235651 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.235619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:43.334614 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.334583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:43.435424 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.435387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:43.438412 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.438373    2560 generic.go:356] "Generic (PLEG): container finished" podID="2c19a81b-7181-46c3-951d-1b98913cc332" containerID="158921a68d5014279eabbdf3dc298901a3b4f7f1b296236a6c86b6415c24a00f" exitCode=0
Sep 09 12:45:43.438552 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.438445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp" event={"ID":"2c19a81b-7181-46c3-951d-1b98913cc332","Type":"ContainerDied","Data":"158921a68d5014279eabbdf3dc298901a3b4f7f1b296236a6c86b6415c24a00f"}
Sep 09 12:45:43.463349 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.463276    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:45:43.566444 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.566413    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49gxv\" (UniqueName: \"kubernetes.io/projected/2c19a81b-7181-46c3-951d-1b98913cc332-kube-api-access-49gxv\") pod \"2c19a81b-7181-46c3-951d-1b98913cc332\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") "
Sep 09 12:45:43.566635 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.566488    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c19a81b-7181-46c3-951d-1b98913cc332-openshift-service-ca\") pod \"2c19a81b-7181-46c3-951d-1b98913cc332\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") "
Sep 09 12:45:43.566635 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.566551    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls\") pod \"2c19a81b-7181-46c3-951d-1b98913cc332\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") "
Sep 09 12:45:43.566635 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.566582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-metrics-certs\") pod \"2c19a81b-7181-46c3-951d-1b98913cc332\" (UID: \"2c19a81b-7181-46c3-951d-1b98913cc332\") "
Sep 09 12:45:43.566864 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.566830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c19a81b-7181-46c3-951d-1b98913cc332-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c19a81b-7181-46c3-951d-1b98913cc332" (UID: "2c19a81b-7181-46c3-951d-1b98913cc332"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:45:43.568567 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.568536    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c19a81b-7181-46c3-951d-1b98913cc332" (UID: "2c19a81b-7181-46c3-951d-1b98913cc332"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:45:43.568687 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.568579    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c19a81b-7181-46c3-951d-1b98913cc332-kube-api-access-49gxv" (OuterVolumeSpecName: "kube-api-access-49gxv") pod "2c19a81b-7181-46c3-951d-1b98913cc332" (UID: "2c19a81b-7181-46c3-951d-1b98913cc332"). InnerVolumeSpecName "kube-api-access-49gxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:45:43.568687 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.568589    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2c19a81b-7181-46c3-951d-1b98913cc332" (UID: "2c19a81b-7181-46c3-951d-1b98913cc332"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:45:43.667818 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.667786    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:43.667818 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.667814    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c19a81b-7181-46c3-951d-1b98913cc332-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:43.667818 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.667824    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49gxv\" (UniqueName: \"kubernetes.io/projected/2c19a81b-7181-46c3-951d-1b98913cc332-kube-api-access-49gxv\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:43.668047 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:43.667833    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c19a81b-7181-46c3-951d-1b98913cc332-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:45:44.123282 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:44.123247    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:44.445352 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:44.445325    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"
Sep 09 12:45:44.445352 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:44.445338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp" event={"ID":"2c19a81b-7181-46c3-951d-1b98913cc332","Type":"ContainerDied","Data":"f8cf7105c2bc3ae82ef05624ddefc173546bcb37223025a7c8a4e793194929ba"}
Sep 09 12:45:44.445787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:44.445400    2560 scope.go:117] "RemoveContainer" containerID="158921a68d5014279eabbdf3dc298901a3b4f7f1b296236a6c86b6415c24a00f"
Sep 09 12:45:44.463377 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:44.463355    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"]
Sep 09 12:45:44.467903 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:44.467881    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-679f45-78744bbb49-g2fjp"]
Sep 09 12:45:44.772382 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:44.772276    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:46.211430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:46.211397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:45:46.400213 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:46.400182    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c19a81b-7181-46c3-951d-1b98913cc332" path="/var/lib/kubelet/pods/2c19a81b-7181-46c3-951d-1b98913cc332/volumes"
Sep 09 12:45:50.539605 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:50.539517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:50.639672 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:50.639635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:50.807996 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:50.807962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:45:51.316787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:45:51.316757    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:01.677498 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:01.677463    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"]
Sep 09 12:46:01.677995 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:01.677781    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l" podUID="d34fe578-3548-4d72-b0f3-cf3a169dac23" containerName="maas-api" containerID="cri-o://be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28" gracePeriod=30
Sep 09 12:46:01.743967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:01.743927    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:01.830688 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:01.830656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:01.925335 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:01.925309    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:46:01.925785 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:01.925764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:01.993714 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:01.993628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:02.039109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.039079    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khs4k\" (UniqueName: \"kubernetes.io/projected/d34fe578-3548-4d72-b0f3-cf3a169dac23-kube-api-access-khs4k\") pod \"d34fe578-3548-4d72-b0f3-cf3a169dac23\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") "
Sep 09 12:46:02.039221 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.039122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34fe578-3548-4d72-b0f3-cf3a169dac23-openshift-service-ca\") pod \"d34fe578-3548-4d72-b0f3-cf3a169dac23\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") "
Sep 09 12:46:02.039221 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.039206    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-metrics-certs\") pod \"d34fe578-3548-4d72-b0f3-cf3a169dac23\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") "
Sep 09 12:46:02.039351 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.039316    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls\") pod \"d34fe578-3548-4d72-b0f3-cf3a169dac23\" (UID: \"d34fe578-3548-4d72-b0f3-cf3a169dac23\") "
Sep 09 12:46:02.039615 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.039571    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34fe578-3548-4d72-b0f3-cf3a169dac23-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d34fe578-3548-4d72-b0f3-cf3a169dac23" (UID: "d34fe578-3548-4d72-b0f3-cf3a169dac23"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:46:02.041415 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.041384    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34fe578-3548-4d72-b0f3-cf3a169dac23-kube-api-access-khs4k" (OuterVolumeSpecName: "kube-api-access-khs4k") pod "d34fe578-3548-4d72-b0f3-cf3a169dac23" (UID: "d34fe578-3548-4d72-b0f3-cf3a169dac23"). InnerVolumeSpecName "kube-api-access-khs4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:46:02.041526 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.041469    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d34fe578-3548-4d72-b0f3-cf3a169dac23" (UID: "d34fe578-3548-4d72-b0f3-cf3a169dac23"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:46:02.041619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.041603    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d34fe578-3548-4d72-b0f3-cf3a169dac23" (UID: "d34fe578-3548-4d72-b0f3-cf3a169dac23"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:46:02.140402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.140365    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:46:02.140402 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.140403    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khs4k\" (UniqueName: \"kubernetes.io/projected/d34fe578-3548-4d72-b0f3-cf3a169dac23-kube-api-access-khs4k\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:46:02.140609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.140419    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34fe578-3548-4d72-b0f3-cf3a169dac23-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:46:02.140609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.140432    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d34fe578-3548-4d72-b0f3-cf3a169dac23-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:46:02.319331 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.319278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:02.547697 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.547659    2560 generic.go:356] "Generic (PLEG): container finished" podID="d34fe578-3548-4d72-b0f3-cf3a169dac23" containerID="be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28" exitCode=0
Sep 09 12:46:02.547893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.547707    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"
Sep 09 12:46:02.547893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.547722    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l" event={"ID":"d34fe578-3548-4d72-b0f3-cf3a169dac23","Type":"ContainerDied","Data":"be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28"}
Sep 09 12:46:02.547893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.547795    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l" event={"ID":"d34fe578-3548-4d72-b0f3-cf3a169dac23","Type":"ContainerDied","Data":"454e597cbba8962d9e65a8cbfe7a7c6aaebf5aa60b9a6fe95a9e2afd79e0013f"}
Sep 09 12:46:02.547893 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.547828    2560 scope.go:117] "RemoveContainer" containerID="be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28"
Sep 09 12:46:02.557211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.557184    2560 scope.go:117] "RemoveContainer" containerID="be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28"
Sep 09 12:46:02.557557 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:46:02.557537    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28\": container with ID starting with be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28 not found: ID does not exist" containerID="be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28"
Sep 09 12:46:02.557624 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.557567    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28"} err="failed to get container status \"be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28\": rpc error: code = NotFound desc = could not find container \"be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28\": container with ID starting with be0a933119fa96fa7029760e57e96e96119ee4ac58ca4c8701a7dd4061713a28 not found: ID does not exist"
Sep 09 12:46:02.568332 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.568302    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"]
Sep 09 12:46:02.573012 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:02.572956    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-cfcdfd-7877f799bc-ntr4l"]
Sep 09 12:46:04.113543 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:04.113505    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:46:04.400387 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:04.400287    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34fe578-3548-4d72-b0f3-cf3a169dac23" path="/var/lib/kubelet/pods/d34fe578-3548-4d72-b0f3-cf3a169dac23/volumes"
Sep 09 12:46:08.962720 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:08.962679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:09.037140 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:09.037103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:09.361245 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:09.361204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:46:11.991608 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:11.991546    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-76gqg"]
Sep 09 12:46:11.992112 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:11.991808    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bfbcdff9f-76gqg" podUID="a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" containerName="manager" containerID="cri-o://76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83" gracePeriod=30
Sep 09 12:46:12.229167 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.229143    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:46:12.327634 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.327600    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert\") pod \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") "
Sep 09 12:46:12.327826 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.327755    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjzl4\" (UniqueName: \"kubernetes.io/projected/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-kube-api-access-zjzl4\") pod \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") "
Sep 09 12:46:12.327826 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.327789    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-metrics-certs\") pod \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\" (UID: \"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7\") "
Sep 09 12:46:12.329622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.329589    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" (UID: "a18f3866-e99a-4bfb-a50f-ef1a158cc5f7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:46:12.329731 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.329656    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" (UID: "a18f3866-e99a-4bfb-a50f-ef1a158cc5f7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:46:12.329799 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.329775    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-kube-api-access-zjzl4" (OuterVolumeSpecName: "kube-api-access-zjzl4") pod "a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" (UID: "a18f3866-e99a-4bfb-a50f-ef1a158cc5f7"). InnerVolumeSpecName "kube-api-access-zjzl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:46:12.429142 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.429114    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjzl4\" (UniqueName: \"kubernetes.io/projected/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-kube-api-access-zjzl4\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:46:12.429142 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.429142    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:46:12.429320 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.429154    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7-webhook-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:46:12.604655 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.604572    2560 generic.go:356] "Generic (PLEG): container finished" podID="a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" containerID="76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83" exitCode=0
Sep 09 12:46:12.604655 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.604615    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-76gqg"
Sep 09 12:46:12.604884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.604652    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-76gqg" event={"ID":"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7","Type":"ContainerDied","Data":"76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83"}
Sep 09 12:46:12.604884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.604703    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-76gqg" event={"ID":"a18f3866-e99a-4bfb-a50f-ef1a158cc5f7","Type":"ContainerDied","Data":"ec4229eab63f5ea6470ff7988a366c1c9570504ea3e33993a0329371d1c07574"}
Sep 09 12:46:12.604884 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.604729    2560 scope.go:117] "RemoveContainer" containerID="76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83"
Sep 09 12:46:12.614407 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.614384    2560 scope.go:117] "RemoveContainer" containerID="76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83"
Sep 09 12:46:12.614676 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:46:12.614658    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83\": container with ID starting with 76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83 not found: ID does not exist" containerID="76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83"
Sep 09 12:46:12.614738 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.614684    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83"} err="failed to get container status \"76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83\": rpc error: code = NotFound desc = could not find container \"76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83\": container with ID starting with 76ae00f11e16870b409edee5604fcd160f0f58e49bb1458fcc6d1622a76c1c83 not found: ID does not exist"
Sep 09 12:46:12.630413 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.630369    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-76gqg"]
Sep 09 12:46:12.630566 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:12.630434    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-76gqg"]
Sep 09 12:46:13.311005 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:13.310969    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:46:14.402510 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:14.402471    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" path="/var/lib/kubelet/pods/a18f3866-e99a-4bfb-a50f-ef1a158cc5f7/volumes"
Sep 09 12:46:24.538876 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:24.538849    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:46:24.554889 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:46:24.554868    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:47:13.520906 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.520872    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-mtz48"]
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521252    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521264    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521273    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c19a81b-7181-46c3-951d-1b98913cc332" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521279    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c19a81b-7181-46c3-951d-1b98913cc332" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521307    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521312    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521319    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521324    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521331    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" containerName="manager"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521337    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" containerName="manager"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521343    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34fe578-3548-4d72-b0f3-cf3a169dac23" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521348    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34fe578-3548-4d72-b0f3-cf3a169dac23" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521355    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521360    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521366    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011e983e-9b72-4269-88a2-8a822d6a93e9" containerName="maas-api"
Sep 09 12:47:13.521388 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521371    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="011e983e-9b72-4269-88a2-8a822d6a93e9" containerName="maas-api"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521432    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18f3866-e99a-4bfb-a50f-ef1a158cc5f7" containerName="manager"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521439    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="011e983e-9b72-4269-88a2-8a822d6a93e9" containerName="maas-api"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521455    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34fe578-3548-4d72-b0f3-cf3a169dac23" containerName="maas-api"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521461    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cb1436-d1d1-4e8b-8cd9-dd9828e8414d" containerName="maas-api"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521466    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1417eeca-cb52-43de-8dd2-a7a7b3ff60c6" containerName="maas-api"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521472    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521477    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521482    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521487    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy"
Sep 09 12:47:13.521890 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.521492    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c19a81b-7181-46c3-951d-1b98913cc332" containerName="maas-api"
Sep 09 12:47:13.524562 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.524547    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.527967 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.527937    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 12:47:13.528097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.527972    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6fjpd\""
Sep 09 12:47:13.528097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.527972    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 12:47:13.528097 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.527946    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 12:47:13.539382 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.539358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-mtz48"]
Sep 09 12:47:13.663257 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.663215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-webhook-cert\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.663458 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.663378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn2zz\" (UniqueName: \"kubernetes.io/projected/f080883a-326f-4dc1-8fb5-a60aacc41888-kube-api-access-rn2zz\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.663458 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.663447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-metrics-certs\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.764630 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.764597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-webhook-cert\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.764787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.764650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn2zz\" (UniqueName: \"kubernetes.io/projected/f080883a-326f-4dc1-8fb5-a60aacc41888-kube-api-access-rn2zz\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.764787 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.764676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-metrics-certs\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.767166 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.767141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-metrics-certs\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.767273 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.767141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-webhook-cert\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.773928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.773879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn2zz\" (UniqueName: \"kubernetes.io/projected/f080883a-326f-4dc1-8fb5-a60aacc41888-kube-api-access-rn2zz\") pod \"maas-controller-bfbcdff9f-mtz48\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") " pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:13.835331 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:13.835283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:14.109537 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:14.109512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-mtz48"]
Sep 09 12:47:14.110597 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:47:14.110572    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf080883a_326f_4dc1_8fb5_a60aacc41888.slice/crio-d31e1b4ae22836a4925ff8310f7167668db8b1200f38f8b858f1a709afcc4631 WatchSource:0}: Error finding container d31e1b4ae22836a4925ff8310f7167668db8b1200f38f8b858f1a709afcc4631: Status 404 returned error can't find the container with id d31e1b4ae22836a4925ff8310f7167668db8b1200f38f8b858f1a709afcc4631
Sep 09 12:47:14.112284 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:14.112267    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 12:47:14.950531 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:14.950434    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-mtz48" event={"ID":"f080883a-326f-4dc1-8fb5-a60aacc41888","Type":"ContainerStarted","Data":"dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e"}
Sep 09 12:47:14.950531 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:14.950495    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-mtz48" event={"ID":"f080883a-326f-4dc1-8fb5-a60aacc41888","Type":"ContainerStarted","Data":"d31e1b4ae22836a4925ff8310f7167668db8b1200f38f8b858f1a709afcc4631"}
Sep 09 12:47:14.951036 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:14.950536    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:14.971409 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:14.971339    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bfbcdff9f-mtz48" podStartSLOduration=1.46410634 podStartE2EDuration="1.971321059s" totalImagesPullingTime="507.214719ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:47:14.967183334 +0000 UTC m=+2151.013308514" watchObservedRunningTime="2026-09-09 12:47:14.971321059 +0000 UTC m=+2151.017446238"
Sep 09 12:47:25.957109 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:25.957029    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:26.848717 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:26.848683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:47:29.360835 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:29.360802    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:47:35.346314 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:35.346252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:47:35.911858 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:35.911820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:47:36.215658 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:36.215579    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:47:37.394141 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.394109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:47:37.505230 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.505188    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-mtz48"]
Sep 09 12:47:37.505533 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.505503    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bfbcdff9f-mtz48" podUID="f080883a-326f-4dc1-8fb5-a60aacc41888" containerName="manager" containerID="cri-o://dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e" gracePeriod=30
Sep 09 12:47:37.756930 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.756903    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:37.858864 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.858829    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn2zz\" (UniqueName: \"kubernetes.io/projected/f080883a-326f-4dc1-8fb5-a60aacc41888-kube-api-access-rn2zz\") pod \"f080883a-326f-4dc1-8fb5-a60aacc41888\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") "
Sep 09 12:47:37.859026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.858880    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-webhook-cert\") pod \"f080883a-326f-4dc1-8fb5-a60aacc41888\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") "
Sep 09 12:47:37.859026 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.858947    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-metrics-certs\") pod \"f080883a-326f-4dc1-8fb5-a60aacc41888\" (UID: \"f080883a-326f-4dc1-8fb5-a60aacc41888\") "
Sep 09 12:47:37.860959 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.860919    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f080883a-326f-4dc1-8fb5-a60aacc41888" (UID: "f080883a-326f-4dc1-8fb5-a60aacc41888"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:47:37.861092 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.860953    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f080883a-326f-4dc1-8fb5-a60aacc41888" (UID: "f080883a-326f-4dc1-8fb5-a60aacc41888"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:47:37.861092 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.861034    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f080883a-326f-4dc1-8fb5-a60aacc41888-kube-api-access-rn2zz" (OuterVolumeSpecName: "kube-api-access-rn2zz") pod "f080883a-326f-4dc1-8fb5-a60aacc41888" (UID: "f080883a-326f-4dc1-8fb5-a60aacc41888"). InnerVolumeSpecName "kube-api-access-rn2zz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:47:37.960235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.960143    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:47:37.960235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.960184    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn2zz\" (UniqueName: \"kubernetes.io/projected/f080883a-326f-4dc1-8fb5-a60aacc41888-kube-api-access-rn2zz\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:47:37.960235 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:37.960197    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f080883a-326f-4dc1-8fb5-a60aacc41888-webhook-cert\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:47:38.075211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.075174    2560 generic.go:356] "Generic (PLEG): container finished" podID="f080883a-326f-4dc1-8fb5-a60aacc41888" containerID="dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e" exitCode=0
Sep 09 12:47:38.075211 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.075213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-mtz48" event={"ID":"f080883a-326f-4dc1-8fb5-a60aacc41888","Type":"ContainerDied","Data":"dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e"}
Sep 09 12:47:38.075455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.075220    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-mtz48"
Sep 09 12:47:38.075455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.075284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-mtz48" event={"ID":"f080883a-326f-4dc1-8fb5-a60aacc41888","Type":"ContainerDied","Data":"d31e1b4ae22836a4925ff8310f7167668db8b1200f38f8b858f1a709afcc4631"}
Sep 09 12:47:38.075455 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.075322    2560 scope.go:117] "RemoveContainer" containerID="dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e"
Sep 09 12:47:38.084506 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.084483    2560 scope.go:117] "RemoveContainer" containerID="dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e"
Sep 09 12:47:38.084769 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:47:38.084747    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e\": container with ID starting with dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e not found: ID does not exist" containerID="dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e"
Sep 09 12:47:38.084836 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.084782    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e"} err="failed to get container status \"dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e\": rpc error: code = NotFound desc = could not find container \"dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e\": container with ID starting with dccaa007fb31fd5264e32ca7d55a892adbbf8715371caf67b9728e1e19c93b7e not found: ID does not exist"
Sep 09 12:47:38.099463 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.099431    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-mtz48"]
Sep 09 12:47:38.106174 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.106152    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-mtz48"]
Sep 09 12:47:38.399856 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.399827    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f080883a-326f-4dc1-8fb5-a60aacc41888" path="/var/lib/kubelet/pods/f080883a-326f-4dc1-8fb5-a60aacc41888/volumes"
Sep 09 12:47:38.806850 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.806821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:47:38.943545 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.943511    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-7lkwz"]
Sep 09 12:47:38.943897 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.943885    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy"
Sep 09 12:47:38.943941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.943899    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3b1ea9-8c14-44fd-908c-9d09c429c9c8" containerName="istio-proxy"
Sep 09 12:47:38.943941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.943915    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy"
Sep 09 12:47:38.943941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.943920    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c6bcb6f-13ff-4d27-a215-9291670aba2b" containerName="istio-proxy"
Sep 09 12:47:38.943941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.943929    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f080883a-326f-4dc1-8fb5-a60aacc41888" containerName="manager"
Sep 09 12:47:38.943941 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.943934    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f080883a-326f-4dc1-8fb5-a60aacc41888" containerName="manager"
Sep 09 12:47:38.944094 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.943990    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f080883a-326f-4dc1-8fb5-a60aacc41888" containerName="manager"
Sep 09 12:47:38.948420 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.948404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:38.951583 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.951559    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 12:47:38.951703 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.951562    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 12:47:38.951703 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.951594    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 12:47:38.951703 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.951616    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6fjpd\""
Sep 09 12:47:38.962687 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.962665    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-7lkwz"]
Sep 09 12:47:38.968157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.968137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8d482fb-c2e2-45bd-8934-e93d04d551e3-webhook-cert\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:38.968263 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.968176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wxtp\" (UniqueName: \"kubernetes.io/projected/f8d482fb-c2e2-45bd-8934-e93d04d551e3-kube-api-access-7wxtp\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:38.968263 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:38.968200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8d482fb-c2e2-45bd-8934-e93d04d551e3-metrics-certs\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:39.069572 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:39.069479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wxtp\" (UniqueName: \"kubernetes.io/projected/f8d482fb-c2e2-45bd-8934-e93d04d551e3-kube-api-access-7wxtp\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:39.069572 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:39.069527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8d482fb-c2e2-45bd-8934-e93d04d551e3-metrics-certs\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:39.069782 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:39.069621    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8d482fb-c2e2-45bd-8934-e93d04d551e3-webhook-cert\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:39.072157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:39.072126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8d482fb-c2e2-45bd-8934-e93d04d551e3-metrics-certs\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:39.072261 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:39.072126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8d482fb-c2e2-45bd-8934-e93d04d551e3-webhook-cert\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:39.089348 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:39.089326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wxtp\" (UniqueName: \"kubernetes.io/projected/f8d482fb-c2e2-45bd-8934-e93d04d551e3-kube-api-access-7wxtp\") pod \"maas-controller-bfbcdff9f-7lkwz\" (UID: \"f8d482fb-c2e2-45bd-8934-e93d04d551e3\") " pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:39.258333 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:39.258278    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:39.529785 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:39.529759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bfbcdff9f-7lkwz"]
Sep 09 12:47:39.531200 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:47:39.531166    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d482fb_c2e2_45bd_8934_e93d04d551e3.slice/crio-73e5658763c32289baf6ba01a9d27a9859b48194d0986c4389898a99a3cfc593 WatchSource:0}: Error finding container 73e5658763c32289baf6ba01a9d27a9859b48194d0986c4389898a99a3cfc593: Status 404 returned error can't find the container with id 73e5658763c32289baf6ba01a9d27a9859b48194d0986c4389898a99a3cfc593
Sep 09 12:47:40.089187 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:40.089152    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-7lkwz" event={"ID":"f8d482fb-c2e2-45bd-8934-e93d04d551e3","Type":"ContainerStarted","Data":"468f85b13fed537d4f2f5e2b6beeb0abf7f883192566235c16624e707f9e590b"}
Sep 09 12:47:40.089381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:40.089205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfbcdff9f-7lkwz" event={"ID":"f8d482fb-c2e2-45bd-8934-e93d04d551e3","Type":"ContainerStarted","Data":"73e5658763c32289baf6ba01a9d27a9859b48194d0986c4389898a99a3cfc593"}
Sep 09 12:47:40.089381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:40.089253    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:47:40.106598 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:40.106547    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bfbcdff9f-7lkwz" podStartSLOduration=1.725101162 podStartE2EDuration="2.106532913s" totalImagesPullingTime="381.431751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:47:40.105950704 +0000 UTC m=+2176.152075883" watchObservedRunningTime="2026-09-09 12:47:40.106532913 +0000 UTC m=+2176.152658091"
Sep 09 12:47:51.096191 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:47:51.096160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bfbcdff9f-7lkwz"
Sep 09 12:48:03.216819 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:03.216782    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:48:10.809027 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:10.808982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:48:17.812111 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:17.812062    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:48:21.363304 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:21.363252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:48:21.432449 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:21.432419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:48:25.009081 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:25.009045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:48:32.811385 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:32.811347    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:48:41.309904 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:41.309867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:48:48.108809 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:48:48.108724    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:50:14.010825 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:50:14.010788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:50:22.311355 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:50:22.311253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:50:25.313609 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:50:25.313577    2560 scope.go:117] "RemoveContainer" containerID="1a06d34705adce38b972fb06ce77f6caf15fa86f814ef8e47a7fbe276f28df8d"
Sep 09 12:50:28.015124 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:50:28.015095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:50:37.885899 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:50:37.885851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:50:40.420685 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:50:40.420649    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:51:00.524928 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:00.524886    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:51:03.546533 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:03.546494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:51:24.575628 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:24.575602    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:51:24.591969 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:24.591948    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-44tg8_dbd83909-6943-4c36-b38a-74493ca5b9a7/ovn-acl-logging/0.log"
Sep 09 12:51:27.871029 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:27.870996    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:51:29.714594 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:29.714556    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:51:29.810423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:29.810388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:51:33.368408 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:33.368365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:51:33.465827 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:33.465791    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:51:38.717021 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:38.716985    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:51:46.314584 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:46.314548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:51:52.816592 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:52.816557    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:51:53.200554 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.200469    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"]
Sep 09 12:51:53.204494 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.204467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.215575 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.215548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"]
Sep 09 12:51:53.341529 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.341495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-openshift-service-ca\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.341718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.341554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-metrics-certs\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.341718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.341621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-maas-api-tls\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.341718 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.341693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl7ct\" (UniqueName: \"kubernetes.io/projected/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-kube-api-access-zl7ct\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.442366 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.442325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl7ct\" (UniqueName: \"kubernetes.io/projected/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-kube-api-access-zl7ct\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.442553 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.442454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-openshift-service-ca\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.442553 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.442523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-metrics-certs\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.442676 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.442565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-maas-api-tls\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.443148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.443122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-openshift-service-ca\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.445067 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.445041    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-metrics-certs\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.445168 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.445150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-maas-api-tls\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.454343 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.454256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl7ct\" (UniqueName: \"kubernetes.io/projected/f4bb3a3a-67f6-4122-9b0a-33cff95f22d2-kube-api-access-zl7ct\") pod \"maas-api-849567d9dc-r4tb4\" (UID: \"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2\") " pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.515480 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.515446    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:53.787242 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:53.787217    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"]
Sep 09 12:51:53.788507 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:51:53.788481    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4bb3a3a_67f6_4122_9b0a_33cff95f22d2.slice/crio-12fc9f72451111c9c982bb8b2a0fcf33373e4ebd908543c59732ef227caeb1c9 WatchSource:0}: Error finding container 12fc9f72451111c9c982bb8b2a0fcf33373e4ebd908543c59732ef227caeb1c9: Status 404 returned error can't find the container with id 12fc9f72451111c9c982bb8b2a0fcf33373e4ebd908543c59732ef227caeb1c9
Sep 09 12:51:54.465966 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:54.465928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4" event={"ID":"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2","Type":"ContainerStarted","Data":"7e449a66da686a7f1cc884ec5d24f762e5204fc78d9fb02b305cbca0737dc6ec"}
Sep 09 12:51:54.466371 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:54.465991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4" event={"ID":"f4bb3a3a-67f6-4122-9b0a-33cff95f22d2","Type":"ContainerStarted","Data":"12fc9f72451111c9c982bb8b2a0fcf33373e4ebd908543c59732ef227caeb1c9"}
Sep 09 12:51:54.466371 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:54.466049    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:51:54.482970 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:51:54.482917    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4" podStartSLOduration=1.001123097 podStartE2EDuration="1.482901417s" totalImagesPullingTime="481.77832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 12:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:51:54.482004774 +0000 UTC m=+2430.528129951" watchObservedRunningTime="2026-09-09 12:51:54.482901417 +0000 UTC m=+2430.529026615"
Sep 09 12:52:00.478540 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:00.478500    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-849567d9dc-r4tb4"
Sep 09 12:52:00.716591 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:00.716560    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:52:08.107477 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:08.107438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:52:10.518789 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:10.518756    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"]
Sep 09 12:52:10.519184 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:10.518990    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v" podUID="41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" containerName="maas-api" containerID="cri-o://b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2" gracePeriod=30
Sep 09 12:52:11.764390 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.764361    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:52:11.916073 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.915978    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-metrics-certs\") pod \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") "
Sep 09 12:52:11.916073 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.916035    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4jvn\" (UniqueName: \"kubernetes.io/projected/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-kube-api-access-q4jvn\") pod \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") "
Sep 09 12:52:11.916073 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.916056    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-maas-api-tls\") pod \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") "
Sep 09 12:52:11.916430 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.916085    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-openshift-service-ca\") pod \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\" (UID: \"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5\") "
Sep 09 12:52:11.916596 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.916551    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" (UID: "41b3821f-1d2d-47e4-bf71-6d07cedf7ff5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 12:52:11.918314 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.918265    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-kube-api-access-q4jvn" (OuterVolumeSpecName: "kube-api-access-q4jvn") pod "41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" (UID: "41b3821f-1d2d-47e4-bf71-6d07cedf7ff5"). InnerVolumeSpecName "kube-api-access-q4jvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 12:52:11.918314 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.918279    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" (UID: "41b3821f-1d2d-47e4-bf71-6d07cedf7ff5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:52:11.918432 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:11.918369    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" (UID: "41b3821f-1d2d-47e4-bf71-6d07cedf7ff5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 12:52:12.017715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.017681    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-metrics-certs\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:52:12.017715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.017712    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4jvn\" (UniqueName: \"kubernetes.io/projected/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-kube-api-access-q4jvn\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:52:12.017715 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.017723    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-maas-api-tls\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:52:12.017950 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.017733    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5-openshift-service-ca\") on node \"ip-10-0-136-24.ec2.internal\" DevicePath \"\""
Sep 09 12:52:12.572555 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.572517    2560 generic.go:356] "Generic (PLEG): container finished" podID="41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" containerID="b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2" exitCode=0
Sep 09 12:52:12.572743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.572572    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"
Sep 09 12:52:12.572743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.572589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v" event={"ID":"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5","Type":"ContainerDied","Data":"b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2"}
Sep 09 12:52:12.572743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.572641    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v" event={"ID":"41b3821f-1d2d-47e4-bf71-6d07cedf7ff5","Type":"ContainerDied","Data":"9de02937726b23e953165ca95be106eb078fd8b110ed2428a3dafb1b602d3953"}
Sep 09 12:52:12.572743 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.572655    2560 scope.go:117] "RemoveContainer" containerID="b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2"
Sep 09 12:52:12.581518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.581498    2560 scope.go:117] "RemoveContainer" containerID="b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2"
Sep 09 12:52:12.581819 ip-10-0-136-24 kubenswrapper[2560]: E0909 12:52:12.581798    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2\": container with ID starting with b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2 not found: ID does not exist" containerID="b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2"
Sep 09 12:52:12.581901 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.581828    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2"} err="failed to get container status \"b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2\": rpc error: code = NotFound desc = could not find container \"b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2\": container with ID starting with b7dbde3e5ade926c0255eaa024b3170582c1dea7c5809d9e3e2ab2e6582700b2 not found: ID does not exist"
Sep 09 12:52:12.591989 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.591958    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"]
Sep 09 12:52:12.596164 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:12.596136    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c5d9d8b4c-qmr7v"]
Sep 09 12:52:13.712629 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:13.712590    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:52:14.402260 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:14.402224    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" path="/var/lib/kubelet/pods/41b3821f-1d2d-47e4-bf71-6d07cedf7ff5/volumes"
Sep 09 12:52:21.010746 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:21.010708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nvmpg"]
Sep 09 12:52:30.124164 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:30.124124    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vbn7s_b37783f0-2da6-4a95-9c62-fd79b1019313/manager/0.log"
Sep 09 12:52:30.257544 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:30.257508    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bfbcdff9f-7lkwz_f8d482fb-c2e2-45bd-8934-e93d04d551e3/manager/0.log"
Sep 09 12:52:30.382312 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:30.382219    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cs2b4_adf25063-9bb0-4520-a435-3519468d73a9/server/0.log"
Sep 09 12:52:30.509110 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:30.509080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pq4zx_8ceb3c3e-f9cd-4c94-af97-d4126d0fac34/manager/0.log"
Sep 09 12:52:30.621391 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:30.621362    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9_acd2a377-813d-41eb-8680-4ee6db3c575a/copy-manifests/0.log"
Sep 09 12:52:30.640898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:30.640809    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9_acd2a377-813d-41eb-8680-4ee6db3c575a/manager/0.log"
Sep 09 12:52:31.241399 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:31.241375    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-849567d9dc-r4tb4_f4bb3a3a-67f6-4122-9b0a-33cff95f22d2/maas-api/0.log"
Sep 09 12:52:31.709518 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:31.709483    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-f6747_87802ba7-b4a7-48cc-a1fa-d170993a003e/postgres/0.log"
Sep 09 12:52:33.117722 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:33.117692    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-nvmpg_1390a4d7-4743-4573-8ed6-4bc6f1ff99c9/limitador/0.log"
Sep 09 12:52:33.736797 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:33.736759    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-m8t9v_6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa/discovery/0.log"
Sep 09 12:52:33.851452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:33.851419    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9b9df8cfb-9dbml_74833e63-8bd7-4680-a5b2-f6917bb2636e/kube-auth-proxy/0.log"
Sep 09 12:52:34.087268 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:34.087239    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xmtbs_65c307a8-b5ff-4541-9501-a8a493b83b17/istio-proxy/1.log"
Sep 09 12:52:34.813309 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:34.813255    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-jnhrg_37875b79-b443-4acd-961e-d8bf45e352c0/main/0.log"
Sep 09 12:52:35.170571 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:35.170487    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7xx5m_17f21325-1ded-4db8-8669-56ba3047c428/main/0.log"
Sep 09 12:52:40.861118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:40.861089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:52:42.849573 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:42.849529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log" limit=1024
Sep 09 12:52:43.949698 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:43.949664    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9k524_d96a723f-56e9-4550-92c9-abe553637eee/global-pull-secret-syncer/0.log"
Sep 09 12:52:44.095624 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:44.095586    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-94q8q_8448f14b-521e-498f-b39c-0f892bc3e915/konnectivity-agent/0.log"
Sep 09 12:52:44.243218 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:44.243138    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-24.ec2.internal_c16cf88aa13a1d31a699b5b3eff900e5/haproxy/0.log"
Sep 09 12:52:48.282708 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:48.282680    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-nvmpg_1390a4d7-4743-4573-8ed6-4bc6f1ff99c9/limitador/0.log"
Sep 09 12:52:50.398206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:50.398172    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-9p5nf_116bd7eb-18e2-4a54-89ad-d92b93fc370d/monitoring-plugin/0.log"
Sep 09 12:52:50.449815 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:50.449786    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dvjjk_f96f550b-1915-46da-8567-49ab09c2c025/node-exporter/0.log"
Sep 09 12:52:50.470227 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:50.470203    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dvjjk_f96f550b-1915-46da-8567-49ab09c2c025/kube-rbac-proxy/0.log"
Sep 09 12:52:50.497334 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:50.497304    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dvjjk_f96f550b-1915-46da-8567-49ab09c2c025/init-textfile/0.log"
Sep 09 12:52:50.934039 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:50.934004    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-nccmg_3978f786-3818-495d-92cc-97816796eb8c/prometheus-operator/0.log"
Sep 09 12:52:50.954466 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:50.954438    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-nccmg_3978f786-3818-495d-92cc-97816796eb8c/kube-rbac-proxy/0.log"
Sep 09 12:52:51.110253 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:51.110222    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db554b64c-mzmvq_ef19eb43-4e1e-42c1-8a41-87d52d0564a1/thanos-query/0.log"
Sep 09 12:52:51.133377 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:51.133342    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db554b64c-mzmvq_ef19eb43-4e1e-42c1-8a41-87d52d0564a1/kube-rbac-proxy-web/0.log"
Sep 09 12:52:51.162457 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:51.162429    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db554b64c-mzmvq_ef19eb43-4e1e-42c1-8a41-87d52d0564a1/kube-rbac-proxy/0.log"
Sep 09 12:52:51.186276 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:51.186205    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db554b64c-mzmvq_ef19eb43-4e1e-42c1-8a41-87d52d0564a1/prom-label-proxy/0.log"
Sep 09 12:52:51.211840 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:51.211798    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db554b64c-mzmvq_ef19eb43-4e1e-42c1-8a41-87d52d0564a1/kube-rbac-proxy-rules/0.log"
Sep 09 12:52:51.238465 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:51.238439    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5db554b64c-mzmvq_ef19eb43-4e1e-42c1-8a41-87d52d0564a1/kube-rbac-proxy-metrics/0.log"
Sep 09 12:52:54.330877 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:54.330849    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-f5k6k_26ecc0f2-68a1-4a42-8828-25be652520d4/download-server/0.log"
Sep 09 12:52:55.040506 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.040472    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"]
Sep 09 12:52:55.040859 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.040846    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" containerName="maas-api"
Sep 09 12:52:55.040908 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.040860    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" containerName="maas-api"
Sep 09 12:52:55.040944 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.040927    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b3821f-1d2d-47e4-bf71-6d07cedf7ff5" containerName="maas-api"
Sep 09 12:52:55.044234 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.044218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.052898 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.052863    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5ffhw\"/\"default-dockercfg-xxfxj\""
Sep 09 12:52:55.053719 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.053696    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ffhw\"/\"kube-root-ca.crt\""
Sep 09 12:52:55.053889 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.053745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ffhw\"/\"openshift-service-ca.crt\""
Sep 09 12:52:55.057452 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.057426    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"]
Sep 09 12:52:55.114948 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.114916    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-bfb6t_887ed2a1-d0f5-4fb1-bacb-392be83a98fb/volume-data-source-validator/0.log"
Sep 09 12:52:55.205423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.205392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twc48\" (UniqueName: \"kubernetes.io/projected/dd597452-74f5-4956-8264-578389c2b4e2-kube-api-access-twc48\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.205423 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.205424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-proc\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.205619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.205482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-lib-modules\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.205619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.205498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-podres\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.205619 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.205563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-sys\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306206 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-lib-modules\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-podres\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-sys\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twc48\" (UniqueName: \"kubernetes.io/projected/dd597452-74f5-4956-8264-578389c2b4e2-kube-api-access-twc48\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306381 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-proc\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306561 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-podres\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306561 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-lib-modules\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306561 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-sys\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.306561 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.306396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd597452-74f5-4956-8264-578389c2b4e2-proc\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.314433 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.314413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twc48\" (UniqueName: \"kubernetes.io/projected/dd597452-74f5-4956-8264-578389c2b4e2-kube-api-access-twc48\") pod \"perf-node-gather-daemonset-grk48\" (UID: \"dd597452-74f5-4956-8264-578389c2b4e2\") " pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.361544 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.361519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.633148 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.633119    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"]
Sep 09 12:52:55.634802 ip-10-0-136-24 kubenswrapper[2560]: W0909 12:52:55.634760    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddd597452_74f5_4956_8264_578389c2b4e2.slice/crio-2728dccc7df2cd6781d4b83724ba85b97cab8f94981691b7366479d5c7a04d2e WatchSource:0}: Error finding container 2728dccc7df2cd6781d4b83724ba85b97cab8f94981691b7366479d5c7a04d2e: Status 404 returned error can't find the container with id 2728dccc7df2cd6781d4b83724ba85b97cab8f94981691b7366479d5c7a04d2e
Sep 09 12:52:55.808639 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.808603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48" event={"ID":"dd597452-74f5-4956-8264-578389c2b4e2","Type":"ContainerStarted","Data":"c69355fde807baf86a0a2c7a508ac4e50d30dca8521946cb0ef332ea2b8f45ef"}
Sep 09 12:52:55.808810 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.808658    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48" event={"ID":"dd597452-74f5-4956-8264-578389c2b4e2","Type":"ContainerStarted","Data":"2728dccc7df2cd6781d4b83724ba85b97cab8f94981691b7366479d5c7a04d2e"}
Sep 09 12:52:55.808810 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.808687    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:52:55.829539 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:55.829491    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48" podStartSLOduration=0.829476673 podStartE2EDuration="829.476673ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 12:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 12:52:55.827116874 +0000 UTC m=+2491.873242054" watchObservedRunningTime="2026-09-09 12:52:55.829476673 +0000 UTC m=+2491.875601851"
Sep 09 12:52:56.395072 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:56.395043    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qm8dx_e2cb5506-1e6f-44b3-bdac-0d615d255d22/dns/0.log"
Sep 09 12:52:56.416558 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:56.416533    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qm8dx_e2cb5506-1e6f-44b3-bdac-0d615d255d22/kube-rbac-proxy/0.log"
Sep 09 12:52:56.560231 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:56.560201    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcfhg_2997c875-d03c-4d20-9dc7-6ade576be613/dns-node-resolver/0.log"
Sep 09 12:52:57.170259 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:57.170225    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6556d8945f-r947j_f8aaee3f-b63a-4d9c-ad27-d7da7aadebcc/registry/0.log"
Sep 09 12:52:57.245194 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:57.245160    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-phnkk_1d310f15-0c20-4804-b322-3429f9cf5096/node-ca/0.log"
Sep 09 12:52:58.745182 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:58.745144    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-m8t9v_6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa/discovery/0.log"
Sep 09 12:52:58.769205 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:58.769181    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9b9df8cfb-9dbml_74833e63-8bd7-4680-a5b2-f6917bb2636e/kube-auth-proxy/0.log"
Sep 09 12:52:58.826677 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:58.826623    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xmtbs_65c307a8-b5ff-4541-9501-a8a493b83b17/istio-proxy/0.log"
Sep 09 12:52:58.831396 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:58.831368    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xmtbs_65c307a8-b5ff-4541-9501-a8a493b83b17/istio-proxy/1.log"
Sep 09 12:52:59.868908 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:52:59.868881    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-42xlx_ba33ef51-b139-4cad-bc19-58d536f4bfe1/serve-healthcheck-canary/0.log"
Sep 09 12:53:00.587855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:00.587822    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwngl_1ed2dc37-8e5a-401f-aefe-26f57c01e9ce/kube-rbac-proxy/0.log"
Sep 09 12:53:00.609353 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:00.609326    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwngl_1ed2dc37-8e5a-401f-aefe-26f57c01e9ce/exporter/0.log"
Sep 09 12:53:00.631401 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:00.631341    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwngl_1ed2dc37-8e5a-401f-aefe-26f57c01e9ce/extractor/0.log"
Sep 09 12:53:01.824575 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:01.824544    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5ffhw/perf-node-gather-daemonset-grk48"
Sep 09 12:53:03.249802 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:03.249768    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vbn7s_b37783f0-2da6-4a95-9c62-fd79b1019313/manager/0.log"
Sep 09 12:53:03.320012 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:03.319981    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bfbcdff9f-7lkwz_f8d482fb-c2e2-45bd-8934-e93d04d551e3/manager/0.log"
Sep 09 12:53:03.340338 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:03.340307    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cs2b4_adf25063-9bb0-4520-a435-3519468d73a9/server/0.log"
Sep 09 12:53:03.483785 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:03.483751    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pq4zx_8ceb3c3e-f9cd-4c94-af97-d4126d0fac34/manager/0.log"
Sep 09 12:53:03.613118 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:03.613093    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9_acd2a377-813d-41eb-8680-4ee6db3c575a/manager/0.log"
Sep 09 12:53:03.649551 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:03.649516    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9bf5b7c6-2ltw9_acd2a377-813d-41eb-8680-4ee6db3c575a/copy-manifests/0.log"
Sep 09 12:53:04.876016 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:04.875934    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-m8t9v_6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa/discovery/0.log"
Sep 09 12:53:04.888358 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:04.888337    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9b9df8cfb-9dbml_74833e63-8bd7-4680-a5b2-f6917bb2636e/kube-auth-proxy/0.log"
Sep 09 12:53:04.926443 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:04.926419    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xmtbs_65c307a8-b5ff-4541-9501-a8a493b83b17/istio-proxy/0.log"
Sep 09 12:53:04.931519 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:04.931495    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xmtbs_65c307a8-b5ff-4541-9501-a8a493b83b17/istio-proxy/1.log"
Sep 09 12:53:07.100855 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:07.100821    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-m8t9v_6b9965f4-ff12-4c24-bfde-a1b02ae4f3fa/discovery/0.log"
Sep 09 12:53:07.119525 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:07.119496    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9b9df8cfb-9dbml_74833e63-8bd7-4680-a5b2-f6917bb2636e/kube-auth-proxy/0.log"
Sep 09 12:53:07.162691 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:07.162661    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xmtbs_65c307a8-b5ff-4541-9501-a8a493b83b17/istio-proxy/0.log"
Sep 09 12:53:07.167622 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:07.167597    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xmtbs_65c307a8-b5ff-4541-9501-a8a493b83b17/istio-proxy/1.log"
Sep 09 12:53:10.428552 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:10.428513    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-tw8ts_0e054970-a99c-47ff-aad2-576a50e11788/migrator/0.log"
Sep 09 12:53:10.467568 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:10.467540    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-tw8ts_0e054970-a99c-47ff-aad2-576a50e11788/graceful-termination/0.log"
Sep 09 12:53:12.285667 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:12.285634    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-td2j6_314da134-39ef-45e0-a464-d1819f7105f5/kube-multus-additional-cni-plugins/0.log"
Sep 09 12:53:12.308157 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:12.308133    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-td2j6_314da134-39ef-45e0-a464-d1819f7105f5/egress-router-binary-copy/0.log"
Sep 09 12:53:12.331379 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:12.331350    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-td2j6_314da134-39ef-45e0-a464-d1819f7105f5/cni-plugins/0.log"
Sep 09 12:53:12.352760 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:12.352736    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-td2j6_314da134-39ef-45e0-a464-d1819f7105f5/bond-cni-plugin/0.log"
Sep 09 12:53:12.375001 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:12.374980    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-td2j6_314da134-39ef-45e0-a464-d1819f7105f5/routeoverride-cni/0.log"
Sep 09 12:53:12.399082 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:12.399062    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-td2j6_314da134-39ef-45e0-a464-d1819f7105f5/whereabouts-cni-bincopy/0.log"
Sep 09 12:53:12.420992 ip-10-0-136-24 kubenswrapper[2560]: I0909 12:53:12.420971    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-td2j6_314da134-39ef-45e0-a464-d1819f7105f5/whereabouts-cni/0.log"